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abstract 


The  goals  of  the  research  discussed  in  this  report  are: 

(1)  to  create  new  models  of  time-shared  computer  systems  which 
include  important  features  commonly  found  in  real  systems; 

(2)  to  insure  that  the  formulations  of,  and  solutions  to,  these 
models  are  relatively  simple  so  that  they  may  be  used  by 
designers  and  computer  center  managers; 

(3)  to  compare  the  behavior  of  these  models  with  the  behavior  of 
more  complex  systems  through  simulation  studies  and  empirical 
performance  investigations  of  operational  computers;  and 

(4)  to  indicate  some  of  the  ways  these  models  may  be  vised  to 

aid  in  the  design,  evaluation,  and  control  of  time-shared  computers. 

Chapter  1  contains  an  introduction  to  some  important  features  of  current 
time-shared  computers  and  a  survey  and  review  of  many  of  the  current  approaches 

to  their  modeling.  Errors  in  three  well  known  articles  are  discussed  and  cor- 

\ 

rected. 

Chapter  2  presents  a  number  of  new  models  which  are  extensions  to,  and 
modifications  of,  previous  studies.  The  new  features  include  a  more  realistic, 
treatment  of  overhead  degradation  and  processing  quantum  length.  One  of  the 
models  is  a  feedback  queueing  structure  having  two  servers  in  tandem.  The 
results  of  each  model  include  the  mean  value  of  the  time  required  by  the  system 


ii 


to  respond  to  a  request.  In  addition,  exact  and  approximate  expressions  for 
expected  response  time  conditioned  on  service  request  are  developed  and 
compared  with  each  other  to  study  the  accuracy  of  the  approximations. 

Chapter  3  presents  the  results  of  a  number  of  simulation  experiments 
designed  to  examine  the  robustness  of  the  analytic  models.  The  first  model 
is  similar  to  the  first  analytic  formulation.  The  next  two  simulations  are 
based  on  the  tandem  queueing  structure.  The  last  simulation  includes  a 
detailed  model  of  the  scheduling  mechanism  of  TSS/360,  an  operational  time- 
shared  system  marketed  by  IBM. 

Chapter  4  contains  the  results  of  three  empirical  studies  of  actual 
systems.  The  first  two  were  performed  on  TSS/360  and  the  third  was  performed 
on  a  Univac  1108  running  with  EXEC-8,  a  time-sharing  operating  system. 

Chapter  5  contains  a  discussion  of  some  applications  of  the  models 
developed  in  Chapter  2.  The  first  example  is  an  application  of  the  models 
to  a  design  decision  for  the  operating  system  of  a  multi -processor  configura¬ 
tion.  The  next  illustrates  the  way  the  models  may  be  used  in  performance 
evaluation  studies  to  examine  possible  overall  system  improvements  arising 
from  enhancements  to  subsystems.  The  last  example  indicates  how  the  models 
may  be  used  in  a  dynamic  control  system  to  improve  system  performance. 

The  first  appendix  presents  a  number  of  results  which  were  used,  but 
not  derived,  in  earlier  chapters.  The  remaining  appendices  contain  listings 
of  major  programs  used  in  the  research. 

Analytic  models  are  but  one  of  many  tools  available  to  those  who  want 
to  analyze,  measure,  improve,  and  create  better  computing  systems.  One  of 
the  goals  of  this  report  is  to  help  place  this  approach  to  system  modeling 
into  perspective  as  an  important  tool,  not  a  panacea,  for  computer  scientists. 
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CHAPTER  1 


INTRODUCTION 


1.1  THE  USE  OF  ANALYTIC  MODELS  -  AN  OVERVIEW 


"Everyone  today  knows  that  a  queue  is  a  waiting  line.  If  one 
also  takes  the  trouble  to  examine  the  literature,  which  now  is  near¬ 
ing  2000  references  on  the  subject,  he  might  get  the  idea  that  all 
those  contributing  to  the  understanding  of  congestion  phenomena  are 
interested  in  doing  something  about  them  since,  after  all,  queueing 
theory  is  concerned  with  relieving  pain  and  saving  time  for  all  of 
us  who  have  to  wait.  Indeed,  queues  make  a  substantial  demand  on  ur 
very  lives  by  taking  precious  time  from  them. 

But  the  situation  is  getting  worse  in  spite  of  the  fact  that 
in  the  past  seven  years  the  literature  of  queueing  theory  has  in¬ 
creased  by  half  of  its  amount  for  the  previous  fifty  years.  Improve¬ 
ments  do  not  match  the  increase  in  theoretical  developments.  Rarely 
has  so  much  ingenuity  been  shown  in  tackling  a  variety  of  technical 
problems  on  paper  by  some  of  the  ablest  people  in  the  world.  It  may 
be  that  many  additional  good  papers  are  waiting  in  queues  for  publica¬ 
tion.  But  real  life  queues  are  still  primitive,  and  indifference  to 
waiting  by  both  facility  owners  and  resigned  customers  is  a  normal 
state  of  affairs." 

Thomas  L.  Saaty 

"The  big  problem  with  management  science  models  is  that  managers 
practically  never  use  them.  There  have  been  a  few  applications,  of 
course,  but  the  practice  is  a  pallid  picture  of  the  promise.  Much  of 
the  difficulty  lies  in  implementation  and  an  especially  critical  aspect 
of  this  is  the  meeting  between  manager  and  model.  I  believe  that  com¬ 
munication  across  this  interface  today  is  almost  nil  and  that  the  situa¬ 
tion  stands  as  a  major  impediment  to  successful  use  of  models  by  managers 

. A  model  that  is  to  be  used  by  a  manager  should  be  simple, 

robust,  easy  to  control,  adaptive,  as  complete  as  possible,  and  easy  to 
communicate  with." 

2 

John  D.  C.  Little 


The  goals  of  the  research  discussed  in  this  report  are:  (1)  to  create 
new  models  of  time-shared  computer  systems  which  include  important  features  com¬ 
monly  found  in  real  systems;  (2)  to  insure  that  the  formulations  of,  and  solutions 


Saaty,  T.,  "Seven  More  Years  of  Queues,  A  Lament  and  A  Bibliography",  Naval 
Research  Logistics  Quarterly.  Vol.  13,  No.  4,  December,  1966,  p.  447. 

2 

Little,  John  D.  C. ,  "Models  and  Managers:  The  Concept  of  a  Decision  Calculus", 
Management  Science.  Vol.  16,  No.  8,  April  1970,  p.  B-466. 
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to, these  models  are  relatively  simple  so  that  they  may  be  used  by  designers 
and  computer  center  managers;  (3)  to  compare  the  behavior  of  these  models 
with  the  behavior  of  more  complex  systems  through  simulation  studies  and 
empirical  performance  investigations  of  operational  computers;  and  (4)  to 
indicate  some  of  the  ways  these  models  may  be  used  to  aid  in  the  design, 
evaluation,  and  control  of  time-shared  computers.  The  quotations  from  Saaty 
and  Little  indicate  that  often  theoretical  results  of  operations  research 
studies  are  not  applied  to  practical  situations.  The  Institute  of  Management 
Science  recently  changed  the  name  (and  the  focus)  of  one  of  its  periodicals 
to  Interfaces  in  an  attempt  to  bridge  this  implementation  gap. 

Two  reasons  why  computing  system  models  often  remain  unused  are  that 
articles  describing  them  seldom  contain  discussions  about  their  validity 
for  describing  observed  phenomena  and  that  often  the  results  are  so  complicated 
that  users  are  not  willing  to  invest  the  time  needed  to  understand  the  model 
and  its  behavior.  The  main  purpose  of  descriptive  models  is  to  account  for 
observed  phenomena  of  physical  systems.  The  complexity  of  most  actual  sys¬ 
tems  requires  that  any  particular  model  address  itself  to  a  limited  and  con¬ 
strained  subset  of  state  variables.  Thus  each  model  is  an  abstraction  of 
a  particular  set  of  important  features  of  interest  to  an  analyst  or  designer. 
Simplifications  required  to  make  an  abstraction  manageable  by  a  particular 
solution  technique  limit  both  scope  and  power.  Since  analytic  models  are 
characterized  by  symbolic  formulations  and  deductive  derivations,  they  require 
many  simplifying  assumptions.  The  consequences  of  these  assumptions  must  be 
explored  before  one  applies  the  model. 

For  the  study  of  computing  systems  there  are  two  other  tools  which  are 
related  to  analytic  modeling: 
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(1)  the  construction  of  large,  detailed,  simulations 

(2)  the  design  and  implementation  of  empirical  investigations 

All  three  methods  have  areas  of  applicability  which  intersect.  For  example, 
analytic  models  often  expand  to  the  point  where  a  large  amount  of  computa¬ 
tional  effort  is  required  to  calculate  results.  Often  a  point  is  reached 
when  a  modest  simulation  may  be  a  more  cost  effective  approach.  Large  simula¬ 
tions  may  eventually  grow  into  system  prototypes,  and  empirical  investiga¬ 
tions  can  provide  insight  required  to  design  better  models.  Analytic  models 
often  indicate  which  of  many  possible  parameters  or  subsystems  are  good 
candidates  for  more  detailed  study  via  simulation  and  experimentation. 

Another  important  use  for  analytic  models  is  as  a  reference  system  for  statis¬ 
tical  analysis  of  simulation  results.  For  example,  Gaver  (1969)  presents 
evidence  showing  how  the  classic  Monte  Carlo  technique  of  control  variates, 
which  makes  use  of  an  approximate  model,  can  improve  simulation  efficiency 
by  reducing  the  variance  of  parameter  estimates  from  simulation  experiments. 

To  be  useful,  analytic  formulations  should  include  the  essential  features 
of  a  system,  or  subsystem,  and  should  have  solutions  that  are  readily  under 
standable.  The  necessity  of  spending  excessive  computer  effort  to  solve 
for  each  parameter  value  of  an  analytic  model  casts  doubt  upon  its  usefulness 
since  simulations  typically  can  handle  more  detailed  cases  with  similar  effort. 
The  conclusion  from  these  considerations  is  that  analytic  models,  simulation 
studies,  and  empirical  investigations  should  complement  one  another  in  the 
study  of  computing  systems.  The  new  models  developed  in  the  next  chapter 
add  to  the  tools  available  for  analytic  performance  analysis. 

Section  1.2  contains  an  introduction  to  some  important  features  of 
time-shared  computer  systems,  and  Section  1.3  contains  a  survey  and  review 
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of  many  of  the  current  approaches  to  their  modeling.  Errors  in  three  well 
known  articles  are  discussed  and  corrected. 

Chapter  2  presents  a  number  of  new  models  which  are  extensions  to,  and 
modifications  of,  previous  studies.  The  new  features  include  a  more  realistic 
treatment  of  overhead  degradation  and  processing  quantum  length.  One  of  the 
models  is  a  feedback  queueing  structure  having  two  servers  in  tandem.  The 
results  of  each  model  include  the  mean  value  of  the  time  required  by  the  sys¬ 
tem  to  respond  to  a  request.  In  addition  .exact  and  approximate  expressions 
for  expected  response  time  conditioned  on  service  request  are  developed  and 
compared  with  each  other  to  study  the  accuracy  of  the  approximations. 

Chapter  3  presents  the  results  of  a  number  of  simulation  experiments 
designed  to  examine  the  robustness  of  the  analytic  models.  The  first  model 
is  similar  to  the  first  analytic  formulation.  The  next  two  simulations  are 
based  on  the  tandem  queueing  structure.  The  last  simulation  includes  a 
detailed  model  of  the  scheduling  mechanism  of  TSS/360,  an  operational  time- 
shared  system  marketed  by  IBM. 

Chapter  4  contains  the  results  of  three  empirical  studies  of  actual 
systems.  The  first  two  were  performed  on  TSS/360  and  the  third  was  performed 
on  a  Univac  1108  running  with  EXEC-8,  a  time-sharing  operating  system. 

Chapter  5  contains  a  discussion  of  some  applications  of  the  models 
developed  in  Chapter  2.  The  first  example  is  an  application  of  the  models  to 
a  design  decision  for  the  operating  system  of  a  multi-processor  configuration. 
The  next  illustrates  the  way  the  models  may  be  used  in  performance  evaluation 
studies  to  examine  possible  overall  system  improvements  arising  from  enhance¬ 
ments  to  subsystems.  The  last  example  indicates  how  the  models  may  be  used 
in  a  dynamic  control  system  to  improve  system  performance. 
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The  chapter  concludes  with  an  evaluation  of  the  techniques  and  points  to 
future  work. 


1.2  IMPORTANT  FUTURES  OF  TIME-SHARED  SYSTEMS 

"It  is  now  possible  for  users 

to  be  connected  by  a  pair  of  wires  to  a  powerful  computer  system 
that  may  be  in  the  next  room  or  may  be  many  miles  away.  All  users, 
wherever  they  are,  have  instant  access  to  the  computer,  and  can  ex¬ 
pect  a  response  to  their  demands  that  is  limited  only  by  the  fact  that 
the  computer  must  share  its  time  between  all  the  users.  The  develop¬ 
ment  of  such  systems  is,  however,  still  in  its  infancy,  and  much  develop¬ 
ment  of  hardware  and  software  must  take  place  before  users  can  be  given 
everything  that  they  have  a  right  to  demand.  There  is  no  doubt  that, 
in  a  few  years  time,  the  best  of  the  currently  operating  systems  will 
appear  very  primitive  indeed." 

M.  V.  Wilkes 


Time-Sharing  Computing  Systems,  by  Wilkes  (1968),  is  a  good  introduction 
to  the  hardware  and  software  features  included  in  many  time-shared  structures. 
It  will  provide  a  good  background  to  the  non  specialist. 

Figure  1.1  illustrates  the  basic  features  of  many  time-shared  systems. 
Users  submit  tasks  from  terminal  devices  to  the  system.  A  task  may  be  con¬ 
ceptualized  as  a  job  step  which  requires  the  use  of  a  number  of  system  re¬ 
sources  to  be  completed.  The  computer's  operating  system  controls  and  al¬ 
locates  these  resources,  such  as  primary  and  secondary  memory,  channels,  and 
processors,  so  that  users  requiring  small  amounts  of  resources  will  get  a 
rapid  response  from  the  system.  In  this  report  response  time  will  be  defined 
as  the  elapsed  time  from  task  submittal  to  task  completion.  If  a  particular 
task  keeps  a  resource  such  as  the  central  processor  occupied  for  a  time  period 
that  would  seriously  affect  the  response  of  other  jobs  in  the  system,  it  is 
interrupted  and  placed  in  the  system  of  queues  while  another  task  uses  the 
resource.  When  the  system  has  finished  with  all  of  the  work  associated  with 
3 

Wilkes,  M.  V. ,  Time-Sharing  Computer  Systems,  American  Elsevier  Publishing 
Company,  Inc.,  New  York,  1968,  p.  2. 
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the  task  it  gives  the  user  an  appropriate  output  message.  Using  the  con¬ 
tent  of  this  message,  the  user  formulates  his  next  job  step,  and  in  "his 
manner  cyclic  interactions  continue  until  the  user  leaves  the  system.  A 
major  goal  of  such  designs  is  to  encourage  users  to  interact  with  data  and 
programs.  If  interaction  is  very  slow  or  cumbersome,  effectiveness  will 
diminish.  Short  requests  usually  receive  high  priority  through  an  interrupt 
scheme  that  allows  the  central  processor  to  switch  to  a  new  task  whenever 
the  active  one  is  delayed  or  exceeds  a  maximum  processing  threshold  called 
a  quantum  interval.  In  this  way  the  central  processor  divides  its  capacity 
among  tasks  awaiting  execution.  When  a  user  submits  a  request  that  will 
require  minutes,  or  even  hours,  of  central  processing  time,  interactive 
response  should  not  be  greatly  affected.  The  user  with  a  long  task  must 
realize  that  due  to  resource  sharing  with  interactive  requests,  his  job  will 
take  longer  on  a  shared  system  than  on  a  batch  system  of  equal  capacity. 

A  "good  model"  must  predict  both  fast  response  time  for  short  jobs  and  response 
degradation  for  long  ones. 

Another  observed  phenomenon  of  time-sharing  is  non-linear  degradation 
of  response  time  as  a  function  of  system  load.  Systems  can  provide  good 
response  only  within  a  limited  range  of  input  demand.  If  demand  exceeds 
this  range,  response  time  deteriorates  rapidly.  Because  of  this  degradation, 
many  systems  arbitrarily  limit  the  number  of  users  who  are  allowed  to  inter¬ 
act  simultaneously  with  the  computer.  Non-linear  response  to  increasing  de¬ 
mand  is  another  physical  observation  which  should  be  a  derived  consequence 
of  a  "good  model". 

Computing  structures  allowing  frequent  task  switching  and  quanta  inter¬ 
ruptions  add  overhead  time  to  that  already  present  in  the  basic  operating 
system.  This  addition  arises  because  of  many  bookkeeping  functions  required 
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to  maintain  status  lists  of  tasks  and  shared  resources.  A  "good  model"  of 
time-sharing  systems  should  explicitly  considei  overhead  degradation. 

The  random  nature  of  actual  quantum  intervals  is  often  ignored  in  analytic 
models.  Input/output  requests,  paging  demands  in  systems  with  virtual 
memory,  supervisor  calls,  and  external  interrupts  are  causes  of  quantum 
ends,  in  addition  to  task  completions  and  quantum  overruns  that  combine  to 
make  actual  quanta  random.  The  following  statistics  from  a  user  session  at 
Carnegie-Mellon  University  on  an  IBM  36 0/ 6 7  demonstrate  that  the  IBM  time¬ 
sharing  monitor,  TSS,  processes  interrupts  occurring  most  frequently  for 
reasons  other  than  task  completion  or  excessive  central  processor  utilization 
during  an  interaction.  Figure  1.2  is  a  state  transition  diagram  illustrat¬ 
ing  the  results  of  a  probe  of  a  typical  user  session. 

Numbers  on  the  figure  are  frequencies  of  events.  During  this  16  minute 
probe,  927  separate  interactive  job  steps  generated  30,856  interruptions  to 
normal  processing,  an  average  of  approximately  33  interrupts  per  interaction. 

Only  367,  or  about  one  percent,  of  these  interrupts  were  processing  quantum 
overruns.  A  random  event  such  as  a  reference  to  part  of  a  program  not  cur¬ 
rently  in  core  (a  page  fault)  triggered  the  vast  majority  of  quantum  aborts. 

The  software  monitor  used  to  gather  these  statistics  creates  an  output 
record  for  every  internal  system  event  of  interest.  The  analyst  initializes 
a  particular  probe  by  informing  TSS  which  events  are  to  be  traced,  and  tie 
system  saves  the  resulting  output  on  magnetic  tape  for  later  statistical  analysis. 
Deniston  (1969)  describes  the  design  and  performance  characteristics  of  this 
type  of  measurement  technique. 

The  preceding  review  summarized  a  number  of  important  features  of  opera¬ 
tional  time-shared  systems.  The  next  section  indicates  the  kinds  of  struc¬ 
tures  currently  in  use  to  model  them.  The  highly  variable  nature  of  time-sharing 
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interactions  indicates  that  probabilistic  methods  should  form  a  basis  for 
system  analysis.  Queueing  formulations  often  become  very  complicated  even 
though  the  models  are  easy  to  describe.  Thus  one  must  carefully  select 
areas  to  study  within  a  system  or  queueing  theory  will  be  of  little  help. 

1.3  A  SELECTED  REVIEW  OF  ANALYTIC  TIME-SHARING  MODELS 

Time-sharing  models  have  grown  at  a  rate  paralleling  that  of  actual  sys¬ 
tems.  McKinney's  (1969)  survey  and  annotated  bibliography,  containing  35 
references,  categorizes  most  contributions  through  1969.  An  earlier  paper 
by  Estrin  and  Kleinrock  (1967)  presents  a  useful  taxonomy  of  analytic  models 
and  a  review  of  simulation  and  measuranent  studies  of  several  systems.  These 
references  are  excellent  introductions  to  the  general  area  of  time-sharing 
models.  The  more  limited  goal  of  this  section  is  to  trace  the  development 
of  models  upon  which  the  work  of  Chapter  2  depends. 

Figure  1.1  may  be  used  as  a  conceptual  framework  to  classify  many  models. 
The  user  subsystem  generates  tasks  for  the  computing  subsystem.  There  are 
two  common  ways  of  modeling  the  input  process.  The  most  common  approach 

is  to  assume  that  requests  arrive  at  the  computer  according  to  a  homogeneous 

4  ... 

Poisson  process  with  arrival  rate  X  jobs  per  unit  time.  This  assumption  is 

equivalent  to  stating  that  interarrival  times  between  requests  have  an  ex¬ 
ponential  distribution  with  mean  l/x  time  units.  This  model  of  the  arrival 
process  also  assumes  that  the  input  rate  is  independent  of  the  behavior  of 
the  computer  subsystem.  The  common  queueing  terms  for  this  assumption  are 
the  "exponential-,  infinite  source"  input,  or  the  "Poisson  source". 

The  other  common  approach  to  the  arrival  process  is  to  a ssume  a  finite 
number  of  independent  users,  each  of  whom  submits  a  task  and  waits  until  it 
5  : 

Section  2.2  contains  a  summary  of  many  of  the  properties  of  a  Poisson  process. 
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has  been  satisfied  before  submitting  another.  For  this  case  "think-time", 
commonly  defined  as  the  interval  between  response  to  one  task  and  submittal 
of  the  next,  for  each  of  the  users,  has  an  exponential  distribution  with 
mean  l/\  time  units.  For  this  "finite  source"  model  the  combined  arrival 
rate  to  the  computer  depends  upon  the  number  waiting  for  service  since  a  user 
may  submit  only  one  task  at  a  time.  This  structure  is  self  balancing  since 
the  input  rate  decreases  as  the  system  becomes  overloaded. 

The  exponential  distribution  is  central  to  most  analytic  time-sharing 
models.  If  time  between  events  is  distributed  exponentially,  and  an  event 
has  not  occurred  for  t  time  units,  the  time  remaining  until  the  next  event 
has  the  same  exponential  distribution  as  the  original  inter-event  interval. 

This  memoryless,  or  Markov,  property  permits  many  simplifications  in  model 
structure  because  state  information  concerning  elapsed  time  since  a  prior 
event  is  unnecessary. 

Four  empirical  system  studies  support  the  approximate  exponential  shape 
of  interarrival  time  distributions,  but  the  measurements  usually  have  higher 
variance  than  predicted  by  the  exponential  (Totschek,  1965;  Coffman  and  Wood, 
1966;  Bryan,  1967;  Scherr,  1967).  Although  the  exponential  does  not  fit  the 
data  exactly,  the  additional  complexity  introduced  by  allowing  general  inter¬ 
arrival  distributions  is  not  justified  for  models  having  simple  results  as 
5 

a  major  goal.  Greater  input  variance  causes  slightly  increased  system  congestion 
There  are  also  two  common  ways  of  modeling  the  basic  service  philosophy 
of  a  time-sharing  organization.  The  first,  and  more  realistic,  is  the  "round 
robin  model"  in  which  one  explicitly  considers  a  quantum  interval  during 
which  a  single  task  receives  all  the  power  of  the  central  processing  unit. 

See  Saaty  (1961),  Chapters  9  and  10,  for  formulations  of  queueing  systems 
having  generalized  input  processes. 
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If  the  task  does  not  terminate  naturally  during  this  interval,  it  is  inter¬ 
rupted  and  forced  to  rejoin  the  queue  of  waiting  users  while  some  other  task 
gains  access  to  the  processor.  Some  models  include  priority  levels  in  the 
queueing  subsystem.  The  terms  "processor-shared"  or  "pure  time-sharing 
denote  the  second  basic  service  approach  which  may  be  viewed  as  a  limiting 
case  of  the  first  method.  At  each  instant,  the  fixed  processor  capacity,  C 
instructions  per  time  unit,  is  uniformly  shared  by  all  active  tasks.  Each 
of  M  active  jobs  receives  c/m  units  of  computing  power  per  unit  time.  In 
the  limit,  as  the  quantum  interval  approaches  zero,  the  finite  quantum,  round 

robin  model  becomes  the  processor-shared  system. 

One  of  the  early  works  to  consider  a  feedback  qurueing  structure  similar 
to  Figure  1.1  was  the  paper  by  Takacs  (1963).  His  problem  arose  in  studies 
of  the  theory  of  telephone  traffic,  and  there  is  no  mention  of  either  time¬ 
sharing  or  computer  system  design.  His  formulation  includes  an  infinite  ex 
ponential  source,  a  finite  and  random  quantum  interval,  and  total  service 
times  which  are  the  sum  of  a  geometrically  distributed  number  of  quanta  each 
of  which  is  drawn  from  the  same  generalized  distribution.  He  solved  this 
model  for  the  expected  number  of  tasks  in  the  system  and  for  the  unconditioned 
moments  of  response  time  for  a  r^/est.  (An  interesting  aspect  of  the  study 
was  the  use  of  a  symbolic  differentiation  computer  program  to  find  the  complicat¬ 
ed  expression  for  the  second  moment  of  response  time.) 

Chang  (1966)  realized  the  applicability  of  the  Takacs  work  to  the  time¬ 
sharing  domain  and  redefined  a  number  of  parameters  to  be  consistent  with 
computer  terminology.  He  extended  the  original  model  to  consider  a  random 
selection  of  the  quantum  distribution,  but  he  solved  the  extension  only  fot 

6  Coffman  and  Kleinrock  (1968)  summarize  many  of  the  models  of  these  service 
disciplines.' 
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the  generating  function  of  the  number  of  queued  tasks  at  the  end  of  a  quantum 
or  at  the  instant  of  a  job  departure.  Neither  author  calculated  mean  response 
conditioned  on  the  amount  of  service  requested.  This  latter  quantity  indicates 
how  a  time-sharing  design  will  respond  to  tasks  requiring  different  amounts 
of  computing  time.  Section  2.3  presents  a  logical  extension  of  the  Takacs 
work  in  which  random  overhead  is  added  to  the  quantum  interval  and  mean 
response  conditioned  on  service  is  calculated. 

Kleinrock  (1964)  first  calculated  expected  response  conditioned  on 
service  for  a  simple  model.  He  constrained  events  to  occur  only  at  discrete 
points  of  time  corresponding  to  constant  service  quanta  of  length  Q.  At 
the  end  of  each  interval  a  new  task  enters  the  first-in-first-out  (FIFO) 
queue  with  probability  XQ;  the  job  being  served,  if  the  system  is  not  empty, 
either  completes  service  (probability  1-cr)  or  rejoins  the  end  of  the  queue 
(probability  ct) ;  and  the  processor  takes  the  job  at  the  head  of  the  queue 
for  a  service  interval  of  length  Q.  Call  the  processing  requirement  of  a  job, 

V.  A  job  having  V  =  nQ  units  is  forced  to  join  the  end  of  the  queue  n  times 
before  its  processing  is  complete.  Kleinrock  calculates  the  steady  state 
expected  number  of  tasks  in  the  system,  E(M)  as  given  in  equation  (1.1). 

He  also  calculates  the  conditional  response  time  for  a  job  requiring  nQ  units 
of  processing,  E(RjnQ),  and  shows  that  a  good  approximation  to  the  latter 
result  is  the  simple  formula  of  equation  (1.2). 

(1.1)  E(M)  =  yfr 

l-r/-XQ 

(1.2)  E(R|nQ)  „  nQ(l  +  ^2_) 

1-ct-XQ 

In  a  later  paper  Kleinrock  (1967)  considers  the  limiting  case  (as  Q  -+  0) 
of  the  above  model.  For  this  processor-shared  case  the  arrival 


process 
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becomes  the  infinite  exponential  source  with  rate  X  jobs  per  unit  time,  and 
the  service  requirement  for  each  task  becomes  an  exponential,  random  variable 
with  mean  l/u  time  units  per  job.  Equation  (1.3)  is  his  result  for  expected 
response  time  conditioned  on  a  processing  need  of  V  time  units.  In  the  con¬ 
cluding  sections  of  the  paper  Kleinrock  further  extends  his  earlier  work 
by  considering  priority  classes  in  the  queueing  structure. 

(1.3)  K(R|V)  =  V-u/ (u-X) 

A  series  of  four  similar  articles  closely  related  to  Kleinrock 1 s  work 
began  with  a  paper  by  Shemer  in  1967.  Tn  these  models  computing  requests 
come  from  an  infinite  exponential  source  having  rale  >  jobs  per  unit  time. 
Processing  requests  arc  exponentially  distributed  random  varial  !es  having  an 
expected  value  of  l/u  time  units.  Each  request  joins  the  cud  of  a  first -in- 
first  -out:  queue  upon  arrival.  Each  task  receives  a  maximum  processing  q  umtum 
interval  of  Q  time  units,  where  Q  is  a  constant.  If  a  request  completes 
service  before  its  time  limit  expires,  it  leaves  the  system  and  the  processor 
immediately  begins  woi'k  on  the  task  at  the  head  of  the  queue.  If  u  job  can¬ 
not  complete  service  during  a  quantum,  it  is  interrupted  and  forced  to  join 
the  end  of  the  queue  while  the  processor  works  on  the  next  waiting  task. 

Figure  1.3  illustrates  this  specific  fora  of  the  general  structure  of  Figure 

1.1. 

For  this  model,  the  expected  number  of  tasks  in  the  system,  and  the 
expected  unconditional  response  time,  are  identical  to  the  results  for  the 
classical  Poisson  source  exponential  service,  single  channel  queueing 
system  (m/m/1).  Shemer  (1967)  uses  these  facts  in  his  derivation  of  expected 
7 

In  queueing  literature,  models  are  often  classified  using  Kendall's  notation: 
a/s/n  where' "a"  denotes  the  type  of  arrival,  "s"  the  type  of  service,  and  "n" 
the  number  of  service  channels.  In  the  example  above  "M"  denotes  Markov,  or 
exponential,  arrival  and  service. 


Probability  (Tasks  finish  during  a  quantum  of  length 
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response  time  conditioned  upon  a  particular  task's  service  request,  but 
he  makes  two  errors.  Using  expected  value  arguments  he  derives  a  recursive 
expression  for  the  mean  time  spent  in  queue  waiting  for  service  quantum  i  as 
a  function  of  the  expected  wait  for  service  quantum  (i-1).  The  derivations 
are  clear  to  follow  and  correct  except  for  i=l  and  i=2.  The  two  properties 
of  the  model  that  Shemer  does  not  treat  correctly  are: 

1.  The  remaining  time,  Qr>  of  a  quantum  interval  in  progress,  if 
the  processor  is  not  idle,  when  a  new  task  enters  the  system 
has  a  distribution  that  is  different  from  the  distribution  of 
a  full  quantum  interval. 

2.  The  conditional  probability  that  a  task  will  return  for  more 
service,  given  that  it  has  already  completed  part  of  a  service 
quantum,  is  different  from  the  probability  that  a  task  just  start¬ 
ing  a  quantum  interval  will  return  for  additional  processing. 

These  errors  propogate  through  all  values  of  i  and  distort  the  final  result. 
Section  2.2  contains  a  discussion  of  the  properties  of  a  quantum  in  progress 
when  a  new  task  arrives  and  Appendix  A  contains  a  correct  derivation  of  this 
model  with  a  slight  extension.  Shemer 's  paper  concludes  with  extensions  to 
the  basic  model  involving  priorities. 

Coffman  and  Kleinrock  (1968)  use  a  slightly  more  complex  approach  to 
study  the  same  model  in  a  paper  which  also  contains  a  number  of  interesting 
extensions  including  priority  scheduling  policies.  Although  both  articles 
were  published  in  the  Journal  of  the  Association  for  Computing  Machinery, 
the  latter  paper  did  not  indicate  the  errors  in  the  earlier  work.  Coffman 
and  Kleinrock  made  a  small  mistake  in  the  derivation  of  the  second  moment 
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of  the  processing  time  actually  received  by  a  task  during  a  quantum.  fheir 
result  is  distorted  also  since  this  intermediate  formula  appears  in  the 
final  expression.  Appendix  A  presents  the  corrected  result  lor  the  second 

moment  of  a  quantum  interval  of  this  type. 

Adiri  and  Avi-Itzhak  (1969)  solved  a  model  similar  to  Figure  1.3  with 
the  addition  of  a  constant  delay,  d,  before  every  processing  quanta.  This 
extension  adds  realism  to  the  basic  model,  and  complicates  the  solution. 

The  delay  represents  constant  overhead  degradation,  or  set-up  time,  required 
by  the  processor  to  switch  from  one  task  to  the  next.  The  added  complexity 
of  the  solution  arises  from  the  fact  that  the  total  processor  time  required 
by  a  task  is  no  longer  exponential.  A  task  needing  V  units  of  processing, 
where  V  is  an  exponentially  distributed  random  variable,  now  requires 
V  +  [V/Q].d  processing  units  where  [X]  denotes  the  largest  integer  greater 
than  or  equal  to  X.  The  results  for  the  expected  number  of  tasks  in  the 
system  and  the  expected  unconditional  response  time  are  now  identical  to 
the  exponential  source,  general  service  time,  single  channel  queueing  system 
(m/g/1) .  The  authors  employ  sophisticated  mathematical  techniques  involving 
complicated  Laplace  transforms  and  generating  functions  to  solve  for  response 
time  conditioned  on  service  request.  The  solution  is  correct  and  reduces  to 
the  results  of  Shemer  (1967)  and  Coffman  and  Kleinrock  (1968)  when  the  delay, 
d,  is  set  to  zero,  and  when  the  corrections  noted  in  the  preceding  paragraphs  are 
incorporated  in  the  earlier  derivations.  To  derive  expected  value  of  response 
conditioned  on  service,  one  may  use  expected  value  techniques  employed  by  the 
previous  authors  rather  than  the  more  involved  methods  used  by  Adiri  and 
Avi-Itzhak.  Since  these  simpler  techniques  are  the  basis  for  the  derivations 
in  the  following  chapter.  Appendix  A  contains  a  proof  that  the  results  from 
the  two  methods  are  identical. 
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Rasch  (1970)  studies  the  model  of  Figure  1.3  and  then  extends  it  in 
almost  the  identical  manner  as  the  work  described  in  the  preceding  paragraph. 
He  adds  a  constant  delay  d  after,  rather  than  before,  each  processing  quantum. 
His  approach  contains  a  major  mathematical  error  not  present  in  any  of  the 
other  three  works.  While  deriving  the  expression  for  expected  waiting  time 
in  the  queue  before  receiving  service  quantum  i,  he  mistakenly  presumes  that 
the  mean  value  of  all  waits  after  the  first  will  be  the  same.  Although  the 
differences  are  small,  and  one  may  wish  to  make  this  simplifying  assumption 
to  achieve  simpler  final  expressions,  one  must  realize  (as  the  other  authors 
did)  that  the  wait  for  service  quantum  i  depends  in  a  non-trivial  way  upon 
the  wait  for  service  quantum(i-l) . 

The  preceding  paragraphs  place  into  perspective  previous  studies  that 
are  in  the  direct  line  of  development  of  the  derivations  of  Section  2.3  and 
2.4.  The  work  of  Section  2.5  has  different  historical  roots  since  it  is  a 
finite  exponential  source,  processor-shared,  model  including  overhead  loss 
as  a  function  of  system  state.  Early  work  in  this  area  is  categorized  in 

g 

queueing  literature  as  "the  machine  interference"  problem.  Sherr  (1967) 
recognized  the  applicability  of  this  work  to  the  time  sharing  domain  and 
presents  an  exponential,  finite  source,  processor-shared  model.  He  compares 
his  results  with  a  simulation  and  with  measurements  taken  from  the  CTSS 
time  sharing  system  at  MIT.  To  approximate  an  overhead  loss  of  X  percent, 
he  simply  reduces  the  capacity  of  the  processor  by  X  percent. 

Attempts  to  solve  the  structure  of  Figure  1.3  with  modifications  of 
a  fir  i '  number  of  exponential  input  terminals  and  a  constant  delay  d  before 
each  quanta  started  with  the  paper  by  Coffman  and  Krishnamoorthi  (1964). 

the  book  by  Saaty  (1961),  p.  ^es  323-333,  for  an  excellent  review  of  re¬ 
sults  of  classic  work  on  machine  interference. 
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This  work  was  expanded  by  Krishnamoorthi  and  Wood  (1966)  and  then  further 
refined  with  the  correction  of  an  error  by  Adiri  and  Avi-Itzhak  (1969b). 

Results  of  these  studies  are  complicated  in  both  the  methodologies  and  the 
form  of  the  expressions.  Greenberger  (1966)  made  a  number  of  mathematical 
approximations  to  achieve  simpler,  although  approximate,  results.  Applying 
a  cost  function  to  service  delays  he  investigates  the  optimal  size  for  the 
quantum  parameter  Q.  In  all  of  these  studies  overhead  delay,  d,  and  maximum 
quantum  size,  Q,  are  constants  and  service  and  input  distributions  are  ex¬ 
ponential. 

A  number  of  other  papers  present  surveys  of  analytic  models  concerned 
with  features  such  as  externally  assigned  priorities  and  service  disciplines 
which  are  dependent  on  system  state.  In  addition  to  the  two  surveys  referenced 
at  the  beginning  of  this  section,  and  the  papers  already  discussed,  the  inter¬ 
ested  reader  is  directed  to  studies  such  as  Coffman  (1966),  Coffman  and  Muntz 
(1969),  and  Schrage  (1967)  and  (1969). 

A  different  modeling  approach  is  based  upon  the  work  of  Jackson  (1963) 
and  Gordon  and  Newell  (1967).  In  these  models  tasks  circulate  among  a 
number  of  service  stations.  Buzen  (1971)  applies  these  methods  to  multi¬ 
programming  systems,  and  Moore  (1971)  applies  them  to  time-sharing  designs. 
Courtois  (1971)  applies  results  of  Simon  and  Ando  (1961),  concerning  the 
dynamics  of  nearly  decomposable  systems,  to  queueing  systems.  His  methods 
significantly  simplify  the  numerical  work  required  to  solve  hierarchical 
queueing  networks. 

Chapter  2  contains  a  number  of  models  which  extend  the  work  reviewed 
in  this  section.  The  aim  of  these  derivations  is  to  include  as  many  fea¬ 
tures  of  real  systems  as  possible  in  model  formulations  which  lead  to  straight¬ 


forward  results. 
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CHAPTER  2 

NEW  ANALYTIC  MODELS  OF  TIME-SHARED  COMPUTER  SYSTEMS 

2.1  INTRODUCTION 

The  analytic  models  presented  in  this  chapter  are  the  end  products 
of  compromises  designed  to  include  a  number  of  important  characteristics 
of  current  time-shared  computer  systems  often  ignored  in  other  analytic 
models,  but  still  to  insure  that  the  results  are  easy  to  understand  and 
compute.  They  focus  on  the  mean  time  required  for  a  time-sharing  system 
to  respond  to  a  user's  request. 

The  survey  of  the  analytical  modeling  literature  in  the  previous 
chapter  revealed  that  overhead  and  swapping  times  are  often  neglected 
in  models  of  time-sharing.  If  considered,  they  appear  almost  exclusively 
as  constant  delays  either  before  or  after  each  service  interval.  Simi¬ 
larly,  even  though  most  time-sharing  systems  have  many  different  quantum 
sizes  based  on  a  job's  priority,  its  recent  history,  and  the  system  state, 
models  in  which  the  quantum  interval  is  a  parameter  usually  consider  it 
to  be  a  constant  and  not  a  random  variable.  Results  of  many  of  these 
models  appear  as  Laplace  transforms  which  often  require  numerical  inver¬ 
sion.  Transforms  are  also  used  directly  to  obtain  moments  of  distribu¬ 
tions  by  differentiation,  but  often  the  results  are  very  complicated. 

(See  the  following  papers  for  illustrations  of  these  statements:  Greenberger , 
1966,  Krishnamoorthi  and  Wood,  1966;  Coffman  and  Kleinrock,  1968;  Adiri 
and  Avi-Itzhak,  1969,  Rasch,  1970.) 

The  new  models  presented  in  this  chapter  extend  previous  work.  The 
first  formulation  includes  features  such  as: 
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1.  a  random  part  of  each  quantum  interval  is  required  for 
overhead  functions 

2.  the  service/execution  segment  of  each  quantum  is  a  random  variable 

3.  the  total  service  request  for  a  task  may  have  any  distribu¬ 
tion  which  can  be  represented  as  a  geometrically  distributed 
sum  of  independent  random  variables,  each  of  which  has  the 
same  arbitrary  distribution 


The  second  model  is  a  tandem  service  structure  which  models  the  multi¬ 
programming  aspects  of  many  systems  by  representing  the  behavior  of  a 
task  as  a  random  number  of  cycles  through  both  a  central  processor  and 
an  input/output  subsystem.  Processing  may  occur  simultaneously  in  each 
subsystem.  The  third  model  is  a  finite  source  system  having  a  processor- 
shared  service  facility  with  overhead  degradation  which  is  a  function  of 
the  state  of  the  system. 

The  following  symbols  v'ill  be  used  in  a  standard  manner  throughout 
the  report.  Other  notation  will  be  introduced  as  needed  in  each  section. 


P(*)  -  the  probability  of  event  (•) 

P ( G | H)  =  the  conditional  probability  of  event  G  given  event  H 

F^(t)  =  the  cumulative  probability  distribution  function  of  a 

random  variable  X 

=  P(X  £  t) 

=  dF  (t)  (the  Stieltjes  integral) 

0  -00  X 

fj,(t)  =  the  density  function  of  a  continuous  random  variable  X 
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E(X)  =  the  expected  value  of  a  random  variable  X 

-  j'l 

E(X| Y)  =  the  conditional  expectation  of  X  given  Y 


aCO 

E(g(X))  =  J  cog(t)dFx(t)  =  the  expected  value  of  a  function  g(*) 

of  a  random  variable  X 

VAK(X)  =  the  variance  of  a  random  variable  X 
-  E((X  -  E(X))2) 

SD(X)  =  the  standard  deviation  of  a  random  variable  X 

1 

=  (VAR(X))7 

L  (s)  =  the  Laplace  transformation  of  a  non-negative  random 

X  variable  X 

=  E(e'sX)  =  f  e"StdF  (t) 

-i  0 

L  (t)  =  the  inverse  Laplace  transformation 

A 


Before  proceeding  to  the  derivation  of  the  models,  the  next  section  will 
review  some  important  properties  about  the  Poisson  process  that  are  used 
throughout  the  chapter. 


2.2  THE  POISSON  PROCESS 


This  section  contains  a  brief  summary  of  a  number  of  well  known 
properties  of  the  Poisson  process  which  are  used  throughout  the  field  of 
queueing  theory.  These  results  are  usually  scattered  throughout  texts.  The 
following  books  contain  good  discussions:  Feller  (1957);  Saaty  (1961); 
Parzen  (1962);  and  Conway,  Maxwell,  and  Miller  (1967).  The  following 
presentation  borrows  extensively  from  the  material  contained  in  Chapter  8 
of  Conway,  Maxwell,  and  Miller  (1967).  This  text  also  contains  an  excel¬ 
lent  bibliography  for  the  reader  interested  in  pursuing  the  subject  in 
greater  depth. 
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2.2.1  Process  Definition 

A  counting  process  is  usually  defined  as  an  integer -valued  process 

[N(t),  t  ^  0}  which  counts  the  number  of  points  occurring  in  an  interval, 

these  points  having  been  distributed  by  some  stochastic  mechanism.  Here 

the  points  represent  the  times  at  which  events  of  a  specified  character 

occurred.  1  Consider  events  occurring  in  time  on  the  interval  0  to 

and  for  t  >  0  define  N(t)  to  be  the  number  of  events  that  have  occurred 

in  the  interval  0  to  t  (the  interval  is  open  at  0  and  closed  at  t).  Let 

N(0)  =  0.  Then, for  a  Poisson  process,  whatever  the  value  of  N(t),  the 

2 

probability  that  during  (t,  t+h)  an  event  occurs  is  X-h  +  o(h  ), 

2 

and  the  probability  that  more  than  one  event  occurs  is  o(h  ).  llie  tern 
o(h2)  denotes  a  quantity  which  is  of  smaller  order  of  magnitude  than  h 
so  that  o(h2)/h  tends  to  zero  as  h  tends  to  zero.  The  Poisson  process 
has  increments  between  events  which  are  independent  and  stationary  in  time. 

The  following  equations  are  derived  consequences  of  the  process 
definition. 

n  -\t 

(2.1)  P(N(t)  =  n)  =  -  —  ~~r~ - ,  n=0,l,2  , . . . 

n  • 

(2.2)  E(N( t) )  =  X-t 

1 

(2.3)  SD(N( t) )  =  (X-t)2 

If  A  is  the  random  time  between  two  successive  events,  then: 

(2.4)  P(A  ^  t)  =  l-e"Xt,  t  s  0 
=  0  ,  t  <  0 

See  Parzen  (1962),  p.  117. 
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(2.5)  E (A)  =  l/\ 

(2.6)  SD(A)  =  l/x 
2.2.2.  Memoryless  Property 

A  consequence  of  the  postulate  that  the  probability  of  an  event 
during  (t,  t+h)  is  independent  of  previous  process  history  is  that  the 
time  until  the  next  event,  given  that  no  event  has  occurred  for  y  time 
units,  is  independent  of  y. 

(2.7)  P(A  >  y+t | A  >  y)  =  P(A  >  t)  =  e'U,  t  >  0,  y  >  0 

Another  interesting  property  of  the  Poisson  process  is  that  if  n  events 
occur  in  an  interval  (0,t),  then  the  n  event  times  are  independently 
and  uniformly  distributed  over  the  interval  (0,t) 


2.2.3.  Branching  and  Aggregation  of  Poisson  Processes 

Consider  a  Poisson  stream  of  events  with  rate  \  which  is  randomly 
split  into  k  different  streams  in  which  the  probability  that  path  i  will 
be  taken  is  p^.  If  the  output  paths  are  chosen  independently,  then  the 
it'1  path  is  a  Poisson  stream  with  rate  \p^. 
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Conversely,  if  k  independent  Poisson  streams,  having  rates  ^»^2*** 

k 

are  aggregated,  the  resulting  stream  is  Poisson  with  rate  X  =  E  X^. 

i_l 


2.2.4  Remaining  Service  Time  Distribution 

Let  jobs  arrive  at  a  server  from  a  Poisson  source.  Given  that  a 

new  job  arrives  while  another  one  is  being  served,  the  remaining  service 

time,  Q  ,  is  defined  as  the  time  interval  from  the  arrival  of  the  new 

job  until  the  service  completion  of  the  one  already  there.  If  service 

intervals,  X,  are  random  variables  with  distribution  function  F^(t) , 

then  Conway,  Maxwell,  and  Miller  (1967)  derive  the  following  two  results 

2 

about  Qr>  the  remaining  service  time: 

(1  -  F  (t))dt 

(2.8)  P(t  £  Qr  ^  t  +  dt)  =  - ,  0  *  r  *  “ 


kfl 

(2.9)  E(qf)  =  e(x7  *  k=l,2* 


r  j .  •  (2.8)  gives  the  probability  that  Qr  will  be  in  a  small  interval, 

and  (2.9)  gives  the  moment  of  Qf.  The  following  diagram  illustrates 


2 Conway,  Maxwell,  and  Miller  (1967),  p.  146-147.  Appendix  A  contains 
derivations  of  equations  (2.8)  and  (2.9).  The  method  used  to  derive 
(2.8)  differs  from  the  approach  of  Conway,  Maxwell,  and  Miller. 
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the  relationship  between  X  and  0  tkq  •.  i . 

H  cween  x,  and  Qr>  The  results  are  conditioned  on  there 

being  a  job  in  service  when  a  new  one  arrives. 


Service  interval  of  length 


-\ 


,  time 


■  r  < 

Arrival  time  X 

of  new  job 

Remaining  service 
interval  of  job  in 
progress  when  new 
job  arrives 

2 ’ 2 ‘ 5  0utPut  of  an  m/m/1 

If  the  arrival  to  a  single  server  qUe„ei„g  system  ^  ^ 

rate  X,  and  the  service  ls  exponential  ult„  r„te  ^  >  x>  and  lf  the  queue 

scheduling  procedure  is  independent  of  the  set  of  processing  times  of  the 

en  rn  the  steady  state  the  departure  intervals  are  independently 
distributed  exponential  variables  with  parameter  X.  I„  „ther  words,  the 
output  process  is  Poisson  with  the  .  rate,  X,  as  the  input  process. 

This  result  may  be  extended  to  the  generalized  birth-death  process,  and 
thus  it  also  applies  to  m/m/h  systems. 

2‘2*6  Results  for  m/g/1  Queue 

If  the  input  process  to  a  single  server  queueing  system  is  Poisson 

with  rate  X,  if  the  processing  time,  X,  has  a  general  distribution  with 

mean  l/y,  and  if  the  traffic  intensit-v  n  -  i/  •  ■, 

intensity  p  -  */n  is  less  than  one,  then  for 

ny  service  discipline  that  is  independent  of  th 


e  processing  times  of  the  jobs 
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(such  as  first-in-first-out),  the  following  results  are  steady  state  values 
for  important  system  parameters. 

(2.10)  E(flow  time  through  queue  and  server)  =  E(R) 

2 •  E(X)  •  (1  -p)  +  X-E(X2)  ,  X-E(X2) 

=  2- (1-p)  M  +  2 - (1-p) 

(2.11)  P(server  is  idle)  =  1-p 

Equation  (2.10)  is  the  classic  Pollaczek-Khintchine  formula.  The  expected 
number  of  jobs  in  the  queue  and  in  the  server  is  related  to  this  result  by  (2.12), 
Little's  theorem  (1961).  These  results  show  that  different  processing  time 
independent  scheduling  rules  have  no  effect  on  the  mean  number  in  the  system, 
the  mean  response  time,  and  the  probability  that  the  server  will  be  idle. 
Scheduling  rules  which  are  independent  of  processing  time  do  have  effects 
on  the  response  times  of  individual  jobs,  but  not  on  the  expected  value  of 
response  for  all  jobs. 

(2.12)  E(number  of  tasks  in  m/g/1  system)  =  X*E(R) 

2.3  A  TIME-SHARING  MODEL  WITH  RANDOM  QUANTA  AND  RANDOM  OVERHEAD  -  TSMODl 

The  model  in  this  section  has  the  following  basic  structure:  a 
Poisson  source  of  tasks;  a  random  delay  drawn  from  a  general  distribution 
representing  overhead  loss  due  to  quantizing;  a  random  processing  quantum 
drawn  from  an  arbitrary  distribution;  and  feedback  to  a  round  robin, 
first-in-first-out  queue.  The  independent  variables  are:  speed  of  the 
processor;  interrupt  probability;  and  the  probability  distributions  of 
quantum  requests,  overhead  delays  caused  by  each  interrupt,  and  interarrival 
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times  between  requests.  The  dependent  variable  is  the  expected  value  of 
the  time  required  by  the  system  to  service  a  request.  Although  analysis 
becomes  complicated,  the  directly  applicable  result  is  simple.  This  model 
is  useful  since  it  retains  simplicity  while  including  a  number  of  essential 
parameters  or  time-shared  systems.  Figure  2.1  illustrates  the  structure 
of  the  model . 


2.3.1  Definitions  and  Model  Formulation 

Define  the  following  symbols  for  use  in  the  model. 


C  =  a  constant  equal  to  the  computer  processing  rate  expressed 
in  instructions  per  unit  time 

Z  —  the  probability  that  a  task  has  been  completed  after  an 
interrupt 

W  =  the  random  number  of  instructions  executed  during  a  pro¬ 
cessing  quantum  before  an  interrupt  occurs 

wi  =  the  i  moment  of  W 

^  —  a  random  variable  denoting  the  number  of  instructions 
required  by  a  task  for  one  complete  interaction 

.  .th 

vi  -  the  1  moment  of  V 

D  =  a  random  variable  representing  the  overhead  delay  of  an 
interrupt 

di  =  the  i^1  moment  of  D 

M  =  the  random  number  of  tasks  in  the  queue  and  in  the  server 

R  =  response  time,  a  random  variable  denoting  the  elapsed 

time  from  task  submittal  to  task  completion  (queue  wait¬ 
ing  time  plus  service  and  overhead  time) 

N  =  the  number  of  interrupts  experienced  by  a  task  during 
the  execution  of  its  V  instructions 

A  =  a  random  variable  expressing  the  interarrival  time  between 
tasks  requesting  service  from  the  system 

Q  =  the  random  length  of  a  auantum  interval  which  is  the  sum 
of  a  service  segment,  W/C,  and  an  overhead  delay  D. 


P(Task  completes  during  a  cycle) 


29 


Structure  of  Model  with  Overhead  -  TSMODl 
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The  original  model  presented  by  Takacs  (1963)  has  the  following 
formulation  and  solution  within  this  more  general  framework.  Requests 

for  service  arrive  at  the  system  from  a  Poisson  source.  If  e  is  the 

th  *■ 

time  the  i  job  enters  the  system,  interarrival  times  are  A  =  e  -e 

i  i  i-1 

All  A^  are  independent,  identically  distributed  random  variables  having 
an  exponential  distribution  with  expected  value  E(A)  =  l/\.  (See  equations 
2.4.  and  2.5.) 

Models  based  on  the  simplistic  assumption  of  constant  quanta  are 
neglecting  a  primary  feature  of  many  real  systems.  A  way  of  approximating 
the  fact  that  tasks  often  return  to  the  queue  after  using  only  a  small 
amount  of  the  maximum  allowable  quantum  (for  example,  to  wait  for  an 
input/output  request)  is  to  make  the  quantum  W  a  random  variable.  The 
server  works  on  tasks  in  a  cyclic,  round  robin  manner.  After  each  task 
receives  a  random  service  quantum  it  either  leaves  the  system  (probability 
&) ,  or  rejoins  the  end  of  the  queue  (probability  l-£)  while  the  processor 
works  on  the  next  task.  The  event,  "job  rejoins  the  queue",  is  indepen¬ 
dent  of  both  the  length  of  quantum  service,  and  the  number  of  quanta  the 
job  has  received.  The  distribution  of  N,  the  number  of  job  interruptions, 
is  geometric  with  expected  value  l/ Z. 

,  n=  1 , 2  , 3 , . . . 

(2.13)  P(N=n)  =  < 

I  0,  elsewhere 

W  may  have  a  general  distribution  function  with  the  obvious  restriction 
that  it  be  non-negative.  The  first  three  moments  of  W  are  wl,  w2 ,  w3. 

The  total  service  request  for  a  complete  interaction,  V,  consists  of  the 
sum  of  a, random  number  of  random  quanta  W. . 
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N 

(2.14)  V  =  S  W. 

i=l  1 

N  has  the  probability  mass  function  specified  in  equation  (2.13).  Equation 
(2.15)  is  the  Laplace  transform  of  V  in  terms  of  the  Laplace  transform 
of  W. 


(2.15)  L  (s)  =  S  (Itf  +<  ^  (s)  •  P ( N=  i ) } 

i=  1  1  “  *  i 

°°  '  '1 
=  ^(^(s))1  ■£  -(1-4) 

=  1^(8)  .  V  (1-^(8)  •(!-«} 


Moments  of  a  distribution  may  be  calculated  from  its  Laplace  transform 
by  differentiation. 


(2.16)  E(V)  =  vl  = 


dLv(s) 

ds 


s=0 


wl/j£ 


2  , 

(2.17)  E(v  )  =v2  =  — ^ - 


ds 


£.w2  +  2.(1-A).(wl) 


s=0 


From  this  viewpoint  total  service  time  per  interaction,  V,  is  deter¬ 
mined  by  SL  and  individual  quantum  times  W^.  V  may  have  any  distribution 
that  can  be  represented  as  the  geometric  sum  of  variables  having  an 
arbitrary  distribution  F^(t). 

For  the  remainder  of  this  section,  consider  C,  the  processing  rate 
of  the  computer,  to  be  one  instruction  per  time  unit  so  that  W  and  V 
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are  measures  of  the  quantum  and  interaction  times,  as  well  as  the  numbers 
of  instructions  executed.  (Quantum  time  =  (number  of  instructions  per 
quantum)/ (processing  rate  of  computer)).  Using  arguments  that  relate 
this  model  to  the  m/g/1  queueing  system,  Takacs  (1963)  establishes  the 
following  formulas  for  the  steady  state  mean  value,  and  second  moment,  of 
response  time  R. 


(2.18)  E(R) 


Xw2  +  2wl(l-Xwl) 
2 ( A-Xwl) 


2  £ -  2  £ 

(2.19)  E(R  )  =  6(ji_Xwi)2[42  -  £(2+Xwl)  +  Xwl] 

•  {2je,[6Xwl3  -  6wl2  -  6Xwlw2  +  3w2  +  Xvl  ] 

-  [12Xwl3  -  12wl2  -  6Xwlw2  +  2X2wlw3  -  3X2w22]} 

The  necessary  and  sufficient  conditions  for  these  equations  to  be  valid 
steady  state  solutions  are  that  Xwl / £  <  1  and  that  w2  and  w3  be  finite. 

The  term  Xwl/ £  is  similar  to  the  standard  definition  of  traffic  intensity, 
p,  which  is  the  mean  arrival  rate  divided  by  the  mean  service  rate.  In 
this  model  the  effective  arrival  rate  is  x/ £  which  includes  tasks  which 
are  fed  back  from  the  server  for  additional  processing.  One  may  apply 
Little's  Theorem  (equation  2.12)  to  equation  (2.18)  to  obtain  the  expected 
number  of  tasks  in  the  system,  E(M). 

2.3.2  A  First  Extension  to  the  Basic  Model 

The  model  described  above  may  be  extended  in  a  number  of  directions 
to  include  more  features  of  time -sharing.  Processor  speed,  and  interrupt 
overhead  become  explicit  independent  variables  in  the  following  analysis. 
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Previously  W  and  V  were  equivalent  to  time  units  since  the  processing 
rate  was  one  instruction  per  time  unit.  C,  the  constant  computer  speed, 
is  expressed  in  instructions  per  unit  time.  W  is  the  number  of  instruc¬ 
tions  processed  before  an  interrupt  occurs,  and  V  is  the  total  number  of 
instructions  required  for  a  task  to  complete  one  interaction.  The  time 
spent  in  one  service  quanta  will  be  W'  =  w/c,  and  total  service  time  for 
one  task  will  be  V'  =  v/c. 

Interrupts  cause  overhead.  For  example,  systems  with  virtual  memory 
structures,  such  as  the  IBM  360/67  and  the  GE  645,  require  approximately 
five  milliseconds  to  process  a  page  fault.3  This  type  of  overhead  may 
be  included  in  the  model  by  adding  an  interrupt  processing  delay,  D,  to 
each  quantum  w/c.  D  is  a  random  variable,  independent  of  W,  having  first 
three  moments  dl,  d2 ,  and  d3.  The  central  processor  continues  to  work  in 
a  cyclic  manner,  but  after  a  quantum  interval  on  one  task,  it  cannot  start 
another  until  the  interrupt  processing  time  D  has  elapsed.  The  addition 
of  D  defines  a  new  total  quantum  time,  Q  =  w/c  +  D  with  first  three  moments 
ql,  q2,  and  q3 .  Using  the  fact  that  the  Laplace  transform  of  the  sum  of 
two  independent  random  variables  is  the  product  of  the  individual  trans¬ 
forms,  one  may  easily  differentiate  L^(s)  to  obtain  its  moments. 

(2.20)  Lq(s)  -  Lw/c(s)  •  Ld(s) 

(2.21)  ql  =  wl'  +  dl  =  wl/c  +  dl 

(2.22)  q2  =  w2 '  +  2wl'dl  +  d2  =  w2/c  +2wldl/c  +  d2 

(2.23)  q3  =  w3/c3  +  3dlw2/c2  +  3d2wl/c  4-  d3 

3See,  for  example,  the  experiments  performed  on  the  MULTICS  system  at  Ml 
by  Corbato  (1968). 
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Equation  (2.15)  still  defines  the  relationship  between  W  and  V.  The 
addition  of  D  to  W  does  not  change  the  users'  demands,  but  the  processor 
takes  more  elapsed  time  to  satisfy  a  request  in  the  presence  of  overhead 
than  without  it. 

Replacing  wl  and  w2  with  ql  and  q2  (equations  (2.21)  and  (2.22))  in 
equation  (2.18),  leads  to  the  following  expression  for  mean  response  in 
this  system. 


(2.24) 


rxfw2/c2  +  2wldl/c  +  d2}  +  2(wl/c  +  dl)  •  (l-\(wl/c  +  dl)) ] 
E(R)  =  2-[>X(wl/C  +  dl)] 


The  necessary  and  sufficient  condition  for  existence  of  a  steady  state 
solution  is  that  X(wl/c  +  dl)/.#,  <  1.  The  quantity  on  the  left  of  this 
expression  is  the  effective  traffic  intensity  for  the  extended  model. 

One  can  make  the  same  substitution  in  (2.19)  to  investigate  the  behavior 
of  the  second  moment  of  response  time. 


2.3.3  TWo  Examples 

Let  V,  the  number  of  instructions  required  to  complete  a  task's 
request,  have  a  general  non-negative  distribution  with  first  and  second 
moments  vl  and  v2.  Consider  the  simplified  case  of  no  overhead  and  no 
service  interruptions  (dl  =  d2  =  0;  1=  1).  Since  w  =  v,  this  case  cor¬ 
responds  to  batch  processing  where  each  interaction  is  processed  to  comple¬ 
tion.  Equation  (2.24)  reduces  to  (2.10),  the  Pollaczek-Khintchine  result 
for  average  response  in  an  m/g/1  queueing  system.  (The  first  two  moments 
of  service  time  are  vl/c  and  v2/c  .) 

(2.25)  E(R)  = 
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Now  consider  service  to  be  quantized,  but  still  with  no  overhead,  D, 
associated  with  quantum  interrupts.  W  and  l  will  be  adjusted  to  hold 
the  moments  of  V  constant.  The  probability,  f,  of  completing  an 
interaction  after  a  quantum  of  length  W  is  less  than  one.  Substituting 
the  appropriate  variables  from  (2.16)  and  (2.17)  in  (2.24)  one  arrives 
at  the  following  expression  for  the  quantizing  model  without  overhead. 

The  final  form  is  identical  to  (2.25). 


(2.26)  E(R)  =  X[fv2  -  2(1-1)  £vl2)/c^+  2jB(vl/c)(l  -xWc) 


2(1  -  UvT/C) 


=  Xv2/C  +  2(vl/c) (1  -  Xvl/C) 
2(1  -  Xvl/C) 


Equation  (2.26)  is  unintuitive  since,  for  this  model,  quantizing 
without  overhead  has  no  effect  on  E(R),  the  expected  value  of  response 
time.  Any  overhead  will  increase  E(R).  If  quantizing  does  not  improve 
mean  response,  and  actually  degrades  it  due  to  overhead,  one  may  reason¬ 
ably  ask  what  benefit  accrues  from  this  scheduling  policy.  Briefly,  the 
benefit  is  that  short  requests  receive  better  than  average  response  at 
the  expense  of  long  requests.  The  policy  of  favoring  short  interactive 
requests  penalizes  longer  tasks  and  degrades  overall  response  when  there 
is  overhead  associated  with  quantum  interrupts. 

Figure  2.2  illustrates  that  even  though  mean  response  remains  con¬ 
stant  as  more  overhead-free  quantizing  occurs,  the  standard  deviation 
of  response  increases.  For  this  example  each  quantum  is  exponentially 
distributed.  The  total  service  request,  V,  is  also  exponential  since  a 
geometric  sum  of  exponentials  is  an  exponential.  The  mean  of  V  is  held 
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constant  and  the  mean  quantum  size  and  the  mean  number  of  interruptions 
(l/ l)  are  varied.  The  input  rate  increases  to  examine  the  effect  of 
increasing  the  user  demand.  For  each  value  of  X,  mean  response  remains 
constant.  Increased  service  variability  is  another  undesireable  effect 
of  round-robin  scheduling  which  must  be  balanced  by  increased  responsive¬ 
ness  to  short  requests. 

The  effects  of  overhead  on  response  are  obvious  in  the  second  example. 
Let  processor  speed,  C,  be  500,000  instructions  per  second,  and  the  mean 
request  for  a  complete  task,  vl  be  100,000  instructions.  Let  the  standard 
deviation  of  the  instruction  requests  be  150,000  instructions.  The  aver¬ 
age  processing  time  per  task,vl/c»is  200  milliseconds.  The  probability 
that  a  task  will  require  additional  processing  after  an  interrupt  is 
.97  (Z-  l/30) .  Thus  a  task  produces  an  average  of  30  interrupts  per 
interaction,  and  the  mean  non-overhead  quantum  time  between  interrupts 
is  6.67  milliseconds.  Figure  2.3  displays  expected  response,  as  a  func¬ 
tion  of  mean  overhead  delay,  dl,  for  a  number  of  values  of  X.  the  Poisson 
arrival  rate  of  requests.  For  each  curve,  the  standard  deviation  of  D 
is  twice  its  mean  of  dl.  These  results  show  commonly  observed  response 
degradation  caused  by  overhead  delay  and  by  congestion  resulting  from  in¬ 
creasing  arrival  rates. 

2.3.4  Mean  Response  Conditioned  on  Service  Request 

This  section  contains  exact  and  approximate  expressions  for  mean 
response  time  conditioned  on  measures  of  the  service  requirement. 

E(R|N=n)  is  the  expected  response  for  a  particular  task,  requiring  n 
quanta,  which  will  be  marked  and  followed  until  it  leaves  the  system. 

Let  M.  be  the  number  of  tasks  ahead  of  this  tagged  job  (both  in  queue  and 

1 
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in  the  processor)  as  it  enters  the  queue  to  wait  for  its  i^1  processing 
quantum.  Define  the  i^  wait,  T\,  to  be  the  time  the  tagged  job  waits  in 
queue  as  the  tasks  preceding  it  receive  their  quanta. 

M. 

l 

(2.27)  T.  =  £  Q. 

1  k=l  k 

In  this  equation  task  quantum  time,  includes  both  the  random  delay  D 
and  processing  time  w/c. 

The  first  cycle  (i=l)  is  a  special  case  since  the  remaining  quantum 
interval  of  the  task  being  served  when  the  tagged  job  arrives  has  a  dis¬ 
tribution  different  from  other  quanta.  Consider  cycles  after  the  first. 
Processing  quanta  of  all  tasks,  including  the  marked  job,  have  the  same 
distribution.  The  expected  value  of  the  sum  of  m  identically  distributed 
random  variables  is  m  times  their  expected  value.  Thus  the  conditional 
expectation  of  T^  given  =  m  is: 

(2.28)  E(Ti|Mi=m)  =  m*E(Q)  =  m*ql,  i=2,3,... 

Removing  the  condition  by  taking  the  expectation  with  respect  to  M.  leads 
to  the  unconditional  expected  value  of  T^. 

(2.29)  E(Tt)  =  E(Mi)  •  ql;  i=2,3,... 

The  number  of  tasks  in  the  system  at  the  start  of  the  i^  cycle  is 
dependent  on  system  state  changes  during  cycle  (i-1).  The  probability 
that  a  job  will  leave  the  system  after  a  quantum  interval  is  l,  and  the 
probability  that  it  will  return  to  the  queue  is  (1-jfc).  Thus  the  expected 


-40- 


th 

number  of  jobs  in  front  of  the  tagged  job  at  the  start  of  the  i  cycle, 

that  was  also  in  front  of  this  job  at  the  start  of  the  (i-1)  cycle,  is 

(1-f)  •  E(M .  j^).  In  addition,  new  tasks  from  the  input  process  which 

arrive  during  the  tagged  job's  (i-1)  queueing  wait  plus  service  quantum 

.  .  .  . th 

will  also  be  ahead  of  the  tagged  job  as  it  begins  waiting  for  its  1 
quantum.  Since  the  mean  number  of  arrivals  from  an  exponential  source 
with  rate  X  during  time  period  T  is  XT,  the  expected  number  of  new  arrivals 
during  (T1  +  ql)  is  X  •  ^  +  ql).  Taking  the  expectation  with  respect 

to  T.  leads  to  the  following  recursive  expression  for  expected  value  of 
as  a  function  of  the  expected  values  of  ^  and  T^_^. 

(2.30)  E(M  )  =  (1-i)  *  E(M1_1)  +  X  *  (E(T±  j^)  +  ql),  i“2,3,... 

Specification  of  E(M1)  and  E^)  allows  one  to  use  equations  (2.29) 
and  (2.30)  to  calculate  all  future  waits.  Since  the  arrival  process  is 
Poisson  and  independent  of  the  service  process,  a  new  task  arrives  at  a 
random  time.  E(M1)  is  thus  the  steady  state  expected  number  of  customers 
in  the  system,  E(M),  given  by  applying  equation  (2.12)  to  (2.24).  Cal¬ 
culation  of  E^)  is  complicated  by  the  fact  that  when  the  tagged  job 
arrives  at  a  busy  system,  the  task  currently  being  processed  has  been 
in  service  for  a  random  interval  and  its  remaining  quantum  service,  Qr> 
is  distributed  differently  from  other  quanta.  As  indicated  in  Section  1.3 
Shemer  (1967)  did  not  recognize  this  fact  and  his  exponential  service  model 
without  overhead  contains  errors  due  to  this  oversight.  Figure  2.4  illus¬ 


trates  the  situation. 
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a  full  service 
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finish  quantum 
in  process  when 
tagged  job  arrives, 

Or 


Figure  2.4 

Calculation  of  First  Wait  Time, 


Since  ql  is  the  expected  value  of  a  full  service  quantum,  let  qlr 
be  the  expected  value  of  remaining  quantum  service,  Qr,  of  the  job  being 
processed  when  the  tagged  job  initially  arrives  at  the  queue.  Let  P.  be 
the  probability  that  there  are  i  jobs  in  the  system  when  the  tagged  task 
arrives.  Then  the  expected  wait  in  queue  of  this  task  before  it  begin 
service  is  the  sum  of  mean  values  of  the  service  quanta  of  all  queued 
jobs  and  the  expected  remaining  quantum  service  of  the  task  in  the  processor 

(2.31)  E(T1)  =  qi/P!  +  (q1r+<l1)P2  +  (^r+2-ql)-p3  + 

CO 

=  ql.(l-pn)  +  ql  E  ( i-i)p 
r  0  i=1  1 

=  qir-(i-p0)  +  q^ECM)  -  d-p0)) 

=  p»ql r  +  qHE(M)  -  p) 

where  p  =  l-pQ  =  X-ql/A,  (equations  (2.10)  and  (2.16)) 
and  E(Qr)  =  qlr  =  q2/fc*qD>  (equation  2.9). 


-42- 


All  values  necessary  for  the  calculation  of  expected  total  wait,  T,  con¬ 
ditioned  on  the  number  of  required  quanta,  n,  are  now  in  easily  computable 


form. 


n 

(2.32)  E(t| N=n)  =  E  E(T .) 

i=l  1 
n 

=  E(T. )  +  E  E(T  ) 

1  i=2 


One  may  express  this  result  in  closed  form  by  using  equations  (2.29) 
and  (2.30)  and  straightforward  applications  of  the  following  identity  con¬ 
cerning  fin-'te  series. 

(2.33)  l+x+x2+  ...  +xn=  (l-xn+1)/(l-x),  x^l 

*  n+1  ,  x=l 

(2.34)  E(\+1)  *  a(k_1)  .  E(M2)  +  b  - j  ,  k=2,3,... 

where  a  =  (1-ir)  +  X,cll 
b  =  X*ql 


Substitution  of  this  expression  in  (2.32)  leads  to  a  closed  form  for 
E(l|N=n) . 


(2.35)  E(T| N=n)  =  E(T^)  +  ql‘ E(M2) 


{(n-2)(l-a)-a(l-an"2)} 


n=l,2,3, . . . 


ECT^)  is  given  by  (2.31) 

E^)  =  X^Edp  +  ql)  +  (l-Jt)-E(M) 
E(M)  is  given  by  (2.24)  and  (2.12) 


where 
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Expected  total  response,  conditioned  on  N,  is  the  sum  of  mean  expected 
total  wait  and  mean  total  service  given  that  N  =  n. 

(2.36)  E(r| N=n)  =  E(T|N=n)  +  n*ql 

Appendix  A  includes  a  derivation  of  the  results  of  a  different  model 
studied  by  Adiri  and  Avi-Itzhak  (1969)  using  the  techniques  of  this  section 
rather  than  their  complicated  transform  methods.  Their  model  has  a  Poisson 
source  of  requests,  and  constant  swapping  overhead  with  exponential  service 
requests.  The  results  of  the  two  different  types  of  analysis  are  identical 

2.3.5  A  Simplifying  Approximation 

Equation  (2.35)  is  not  an  intuitive  expression.  An  interesting  approx 
mation  is  to  let  mean  waiting  time  in  queue  for  each  cycle  after  the  first, 
E(Ti),  be  equal  to  the  steady  state  expected  number  of  tasks  in  the  system, 
E(M) ,  multiplied  by  the  mean  quantum  interval,  ql.  Table  2.1  demonstrates 
that  the  magnitude  of  the  error  introduced  by  making  this  approximation  is 
small.  The  exact  result,  equation  (2.35),  enables  one  to  measure  effects 
of  such  simplifying  approximations.  Shemer  (1967)  and  Rasch  (1970)  both 
made  approximations  without  realizing  it  and  without  measuring  the  effects. 
These  results  show  that  their  derivations,  although  not  exact,  are  close 
to  the  correct  solutions. 

Equation  (2.31)  is  the  exact  expression  for  E^),  the  mean  wait  in 
queue  before  a  task  begins  to  receive  its  first  service.  One  could  use 
the  approximation  for  this  quantity  also,  but  the  additional  complexity 
added  by  including  the  exact  expression  is  small.  Using  the  approximation 
E^)  «  E(M)  •  ql  in  equation  (2.32)  leads  to  the  following  result  for  mean 


total  wait  in  queue,  given  that  N  =  n. 


-44- 


4h 

O 


a 

I 

8 

a) 

x: 


i 


o 

m 

CM 

i-H 

tl 

H 

3 


3 

CM 

II 

CM 

& 


m 

o 

o 


d 


CM 


CM 

d 


S 

'w' 

w 


I 

d 


r^. 

no 

cn 

o 


CM 

no  no 

I"-  i— 1 
O  i-H 


ON 

m 


NO 

m 

on 


cn 

O 

i-H 

i-H 

CM 

CM 

CM 

m 

m 

Ht 

i-H 

oo 

m 

CM 

cn 

i-H 

m 

ON 

ON 

oo 

oo 

00 

CM 

CM 

cn 

cn 

cn 

i-H 

m 

ON 

w 

u 

a) 

■u 

a) 

I 

u 

<D 

P4 


CM 

a) 

i-H 

CM 


d 

a) 

w 

3 


+ 


<D 

w 

U 

o 

CM 

CD 

o 

ON 

o 

• 

w 

o 

cn 

u 

o 

<D 

• 

m 

II 

4-» 

rH 

rH  CM 

i-H 

m 

<D 

• 

/— s 

cn 

E 

cn 

II  II 

II 

S 

• 

CD 

• 

'w' 

CM 

U 

m 

O  r<* 

w 

CO 

£ 

CL 

d 

Q 

o 

*r4 

0) 

•H 

U 

c/5 

4J 

CD 

a) 

O 

£ 

-fi 

aj 

O' 

H 

CO 

w 

r^.  <t  o 

no  no  no 

cn  r>.  i-h 

O  O  i-H 


cn 

m  m 

r— I  on 


o 

NO 

cn 

o 

NO 

cn 

CM 

CM 

cn 

m 

<fr 

cn 

o 

r^ 

i-H 

cn 

i-H 

m 

ON 

ON 

00 

00 

00 

CM 

CM 

cn 

cn 

cn 

i-H 

m 

ON 

d 

o 


r 

X 

w 


d 

.a 

CO 

Q) 

s: 


d 

•iH 

d 

a) 

w 

d 

<u 

cd 

CO 

iH  • 

a)  cn 
u  • 
a)  cn 
E  _ 
(D  d 
^  O 
CD  »H 

a  u 

a 

a)  a) 
co  w 
0) 

-d  mh 

H  o 


m 

i 


oo 


II 

r<’  »H 

II  II 
u  ^ 


m 

o 


* 

II 

i-H 

d 


m 

CM 

r^ 


CM 

* 


CM 

d 


oo 

cn 


S 

V' 

W 


S 

w 


i-H 

cn 

m 

m 

NO 

00 

ON 

o 

o 

ON 

00 

O' 

CM 

o 

oo 

NO 

vt 

CM 

o 

ON 

00 

00 

ON 

■ 

cn 

i-H 

00 

CM 

NO 

o 

cn 

m 

cn 

i-H 

1 

• 

i-H 

• 

i-H 

t-H 

• 

CM 

CM 

• 

cn 

cn 

• 

cn 

• 

i-H 

• 

m 

H 

'w' 

W 


m 

cn 


d 

o 

•iH 

U 

CD 

d 

cr 

w 


r^ 

o 

o 


cn  o  oo  r- 

^  cm  on 

cn  r--  o 


NO 

NO 

NO 

00 

o 

o 

NO 

ON 

m 

m 

cn 

i-H 

ON 

NO 

o 

e'¬ 

o 

00 

CM 

NO 

ON 

cn 

NO 

en 

cn 

i-H 

CM 

CM 

CM 

cn 

m 

i-H 

m 

ON 

m  no 


oo  on 


o 

CM 


o 

cn 


o 


o 

m 


Table  2.1 

Comparison  of  Exact  and  Approximate  Expressions  for  E(T|N=n) 


-45- 


(2.37)  E(T|N=n)  =  E(T^)  +  (n-1) *ql*  E(M) 

=  p-(q2/2*ql  -  ql)  +  n*ql*E(M),  n=l,2,... 

A  more  interesting  form  of  mean  conditional  response  time  is  to  remove 
the  condition  on  N,  the  number  of  quanta  received  by  a  task,  and  replace 
it  with  a  condition  on  V,  the  actual  processing  request.  To  remove  this 
condition,  one  must  determine  the  distribution  of  the  number  of  quanta 
required  to  fulfill  a  processing  request  v. 

CO 

(2.38)  E(T|v=v)  =  E  E(T| V=v,N=n)-P(N=n|v=v) 

n=  1 

00 

=  p.(q2/2.ql  -  ql)  +  ql-E(M).  £  n*P(N=n| V=v) 

n=l 

To  evaluate  the  infinite  summation  in  the  above  equation,  one  must 
first  determine  P(n|v=v),  the  conditional  probability  that  a  task  will 
experience  N  quanta  given  that  it  requires  v  instructions  from  the  central 
processor.  This  summation  is  the  conditional  mean  of  N  given  that  V  =  v. 
Define  (X)  f(x)  to  mean  that  the  random  variable  X  has  the  distribution 
given  by  f(x).  Let  f  (x)  be  the  n-fold  convolution  of  the  random  variable 

A 

X  (i.e.,  f*n(x)  =  f  (x))  .  The  total  service  request  for  a  task, 

1  n 

V,  is  the  sum  of  N  independent  quanta,  W,  where  N  has  the  probability  mass 
function  defined  in  equation  (2.13). 

(2.39)  (v|  t$=n)  ~  f*n(v) 

if 

(2.40)  (V,N)  ~  fwn(v).P(N=n) 

00 

(2.41)  (V)  ~  f  (v)  -  2  P(N=n).f^n(v) 

n=l 
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(2.42)  P ( N=  n | V=v)  * 


P(N=n)  f*n(v) 

_ w _ 

fy(v) 


£-(l-£)n_1-4n(v) 

- 


,  1,2,., 


One  may  now  substitute  equation  (2.42)  into  (2.38)  to  calculate  the  final 
form  of  the  mean  total  wait  in  queue  conditioned  on  a  service  request  of 
v  instructions.  The  specific  form  of  the  result  will  depend  on  the  density 
function  of  W. 


2.3.6  An  Exponential  Service  Quantum  Example 

A  specific  example  will  illustrate  this  model.  The  use  of  an  ex¬ 
ponentially  distributed  quantum,  W,  keeps  the  mathematics  simple  because: 

(1)  the  sum  of  n  identically  distributed  exponential  variables, 
when  n  is  a  constant,  is  a  random  variable  having  a  gamma 
distribution 

(2)  the  sum  of  N  identically  distributed  exponential  variables, 
when  N  is  a  random  variable  having  a  geometric  distribution, 
is  an  exponential  variable. 

These  two  well  known  facts  may  be  verified  by  calculating  the  appropriate 
Laplace  transforms  and  comparing  them  to  the  transforms  of  the  gamma  and 
exponential  distributions. 

Let  the  density  function  of  W  be  exponential  with  mean  wl.  Therefore 

*n 

the  density  function  of  f^  is  gamma  and  the  density  function  of  V  is  ex¬ 
ponential  with  mean  vl  =  wl/ H. 
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-v/wl 

(2.43)  £  (»)  = 


v  ^  0 


n-1  -v/wl 


(2  44)  fTn(v)  =  (v/wl-). 

(  '  S*  '  '  wl* (n-1) 1 


j  v  ?  0  j  n  ■  1  j  y  •  •  • 


-jfc*v/wl 

(2.45)  fv(v)  =  ^ -  .  v  *  0 


Substituting  the  above  equations  into  (2.42)  leads  to  the  desired  result 
for  P(N|v=v). 


/  n11"1  Q-(1“W-v/wl 

(2.46)  P(N|V=v)  =  —  - — — (nJi)I - *  v  2  °»  arl*2>“‘ 


,  .  wl  +  (l-£)  -v  ^  „ 

(2.47)  E(N|v=v)  =  £  n-P(N|V=w) - »  V  ° 

n=l 

The  conditional  mass  function  for  N,  the  number  of  quanta  needed  to  get  v 
instructions,  is  almost  the  standard  Poisson  distribution  with  parameter 
v(l-D/wl.  Note  that  the  mean  number  of  quanta  needed  to  receive  v  in¬ 
structions  is  not  the  more  intuitive  quantity  v/wl  where  wl  is  the  mean 
nunber  of  instructions  received  per  service  quantum. 

Substituting  (2.47)  in  (2.38)  gives  a  closed  form  for  mean  total  wait 
in  queue  given  that  a  task  requires  v  instructions. 

(2.48)  E(t| V=v)  =  p*(q2/2ql  -  ql)  +  ql *E(M) • E(N|  V=v) 

=  tp.(q2/2ql  -  ql)  +  ql-E(M))  +  ql • E(M) • (l-£) • v/wl ,  v  S  0 

Expected  total  response  conditioned  on  v  is  the  sum  of  the  wait  in  the 
queue,  mean  overhead  associated  with  this  task, (wl  +  (1- A) -v) -dl/wl ,  and 

the  service  time  of  the  task  v/c. 
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(2.49)  E(R | V=v)  =  E(T|v=v)  +  (wl  +  (l-j£) *v)*dl/wl  +  v/c 


=  a  +  B*v 


where  a  s  p*(q2/2ql  -  ql)  +  ql*E(M)  +  dl 
B  =  l/c  +  (ql* E(M)  +  dl) • (1- A)/wl 

The  term  o'  of  the  previous  equation  is  the  expected  value  of  the 
minimum  response  time  possible  in  the  system.  This  unavoidable  delay  is 
the  sum  of  the  task's  overhead  time  and  the  processing  and  overhead  times 
of  the  jobs  already  in  the  queue.  A  physical  interpretation  of  this  term 
is  the  response  time  to  a  null  input  (e.g.,  a  carriage  return).  Note  that 
after  this  initial  delay,  expected  response  is  a  linear  function  of  service 
request  v.  A  common  aspect  of  many  current  time  sharing  models  is  an 
essentially  linear  relationship  between  response  and  service  request.  This 
characteristic  is  present  in  the  earliest  models  as  shown  by  the  form  of 
equations  (1.2)  and  (1.3)  derived  by  Kleinrock,  but  these  early  models  do 
not  include  important  features  such  as  random  quanta  and  random  overhead. 
E(R)  may  be  obtained  from  (2.49)  by  removing  the  condition  on  v.  Since 
the  expression  is  linear,  one  simply  replaces  v  with  E(V). 

2.4  THE  TANDEM  QUEUEING  MODEL  -  TSM0D2 

A  character is itc  shared  by  almost  all  computer  programs  is  that  they 
can  be  represented  as  repeating  cycles  of  central  processor  activity  fol¬ 
lowed  by  utilization  of  the  input-output,  (i/o),  system.  Multiprogramming 
designs  allow  different  programs  to  use  these  facilities  simultaneously  by 
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switching  control  from  a  program  requesting  i/o  service  to  one  needing  the 
central  processing  unit.  When  the  original  program  has  finished  i/o  ac¬ 
tivity  it  may  queue  for  additional  central  processing  time  and  release  the 
i/o  facility.  Time-sharing  operating  systems  often  force  task  switching 
by  making  a  program  release  control  of  the  central  processor  when  it  has 
exceeded  a  quantum  processing  limit.  Figure  2.5  illustrates  a  basic  tandem, 
two  server  model  of  this  organization.  For  analytical  purposes  it  clearly 
does  not  matter  which  server  is  considered  the  central  processor  and  which 
the  i/o  system. 

Define  the  following  symbols  for  use  in  the  model. 

X  =  the  probability  that  a  job  leaves  the  system  after 
a  cycle  of  processing  and  i/o  activity 

C.  =  a  constant  equal  to  the  processing  rate  of  sub¬ 
system  i  expressed  in  work  per  unit  time 

W.  =  the  exponentially  distributed  random  work  required 
from  subsystem  i  during  a  processing  cycle.  The 
expected  value  of  is  wl  . . 

lij,  =  C  ./wl .  =  the  exponential  service  rate  of  subsystem  i 

N  =  the  random  number  of  cycles  required  by  a  task  to 
finish  one  complete  interaction  with  the  system 

V  =  an  exponentially  distributed  random  variable  de¬ 
noting  the  total  work  required  by  a  task  from 
the  central  processor  in  N  cycles.  The  expected 
value  of  V  is  wl X. 

=  the  random  number  of  tasks  waiting  in  queue  i,  and 
being  served  in  subsystem  i 


P<  task  c  anp  1  *  *  S  erv  l  te  > 


-5 


Structure  of  Tandem  Queueing  System  -  TSM0D2 
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The  assumptions  for  the  model  are: 

(a)  the  input  process  is  Poisson  with  rate  X 

(b)  queue  1  and  queue  2  have  unlimited  capacity 

(c)  the  service  time  in  each  processor  is  exponential  with 

mean  wl^/c^  and  t  respectively 

(d)  after  completing  service  in  the  second  processor  a  task 
rejoins  queue  1  with  probability  (1-2)  and  leaves  the 
system  with  probability  (2).  The  probability  of  rejoining 
queue  1  is  independent  of  all  other  state  variables. 

Jackson  (1963)  presents  a  number  of  important  results  for  networks  of 
Poisson  queues.  A  summary  of  many  of  his  derivations  appears  in  Conway, 
Maxwell,  and  Miller  (1967),  Chapter  10.  Call  the  combined  input  rate  to  the 
first  processor  X'.  It  is  the  sura  of  the  external  Poisson  input,  of  rate  X, 
and  that  portion  of  the  i/o  system's  output  which  is  fed  back  to  the  first 
queue.  This  latter  process  has  a  rate  of  X ' • ( 1  - 2) .  Thus  X',  the  rate  of 
the  combined  input,  is: 

(2.50)  X'  =  X  +  (1-2)  •  X' 
or  X'  =  X/2 

A  key  result  of  Jackson's  analysis  is  that  in  the  network  illustrated  in 
Figure  2.5  the  combined  input  processes  and  the  resulting  output  processes 
are  all  Poisson.  Thus  each  subsystem  may  be  analyzed  as  an  exponential 
server  having  Poisson  input. 
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In  the  steady  state  each  of  the  two  servers  may  be  treated  as  an 
independent  m/m/1  queue  with  input  rate  X',  and  service  rate  p,  = 

Equation  (2.10)  presents  expected  response  in  an  m/g/1  queueing  system. 

This  equation  reduces  significantly  when  service  is  exponential.  Thus 
expected  response  through  subsystem  i,  and  the  sum  of  the  expected  number  of 
tasks  waiting  in  queue  and  being  served  in  subsystem  i,  E(M^),  are: 

(2.51)  E(R.)  =  l/(n.-X')  1*1.2,  u,±  >  X' 

(2.52)  E(Mi)  =*  X,*E(Rj[)  =  1*1, 2,  >  X' 

Let  T  be  the  time  spent  waiting  for  the  central  processor  plus  the 
i 

/  .  th 

time  waiting  and  receiving  service  from  the  I/O  processor  on  the  l  pass 
through  the  system.  Since  all  of  the  stochastic  subsystems  in  this  model 
are  Poisson,  in  steady  state,  job  arrivals  and  departures  occur  at  random 
points  in  time.  For  exponential  service,  the  remaining  processing  time  of 
a  task  is  also  exponential  regardless  of  how  much  service  the  task  has  al¬ 
ready  received.  Thus  the  wait  in  queue  1  is  E^)  •  E(service  quantum),  and 
the  mean  response  time  through  system  2  is  l/(p.2-X’)«  In  steady  state  all 
cycle  times  have  the  same  expected  value. 

(2.53)  E(Ti)  =  E(wait  for  processor)  +  E(wait  +  service  for  i/o  system) 

X '  1 

=  — 7  +  7 - TT7  >  Hi  and  Ho  >  X' 

yk1(M,1-X')  (H2-X  )  ^2 

i=l,2, . . . 

The  conditional  response  time  of  a  job  requiring  v  units  from  the  central 
processor  which  it  receives  in  n  quanta  is: 


1 


(2.54)  E(R|v=v,»=n)  -  n-  +  v/c,,  n=1.2,3 


Removing  the  condition  by  using  (2.46)  leads  to  the  result 
response  conditioned  on  service  request. 

(2.55)  E(R|v=v)  »  a  +  B*  v/c^ 

where  “  =  n^-X')  +  (p^-X* ) 

and  B  =  n^*(l-£)*<y  +  1 


v  ^  0 

p.-^  and  p<2  >  X' 
for  expected 


Figure  2.6  displays  the  non-linear  effect  of  increasing  the  demand  on 
the  system.  For  each  line  on  this  graph,  the  processing  request,  v,  is 
held  constant  and  the  arrival  rate,  X,  is  increased.  Figure  2.7  is  a  graph 
of  expected  response  conditioned  on  service  request,  v,  for  a  number  of 
input  rates  X.  Thus  this  model  also  predicts  both  a  linear  relationship 
between  expected  response  and  service  request,  and  non-linear  response 
degradation  as  a  function  of  system  load. 

2.5  A  PROCESSOR-SHARED  MODEL  WITH  STATE  DEPENDENT  OVERHEAD,  ARRIVAL,  AND 
SERVICE  PROCESSES  -  TSM0D3 

A  fundamental  concept  of  time-sharing  organizations  is  that  the 
power  of  the  central  processing  unit  is  to  be  allocated  to  all  tasks 
demanding  service.  Processor-shared  models  approximate  actual  scheduling 
procedures, such  as  round  robin  time  slicing,  with  an  ideal  discipline  in 
which  fixed  processor  capacity,  C,  is  divided  uniformly  and  delivered  to 
all  active  tasks.  At  every  instant,  each  of  m  active  jobs  receives  c/m 


E  f  R  |  V ) 
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units  of  computing  power  per  unit  time.  Scherr  (1967)  recognized  that 
one  of  the  classic  forms  of  the  general  "birth  and  death"  model  was 
directly  applicable  to  the  time-sharing  problem.  His  formulation  of  the 
problem  allows  one  to  consider  explicitly  the  number  of  terminals  con¬ 
nected  to  the  system.  Scherr  considered  overhead  in  a  simplified  manner 
by  reducing  the  capacity  of  the  central  processor  from  C  to  a  lesser 
value  C'.  The  quantity  (l-C'/c)  represents  the  fraction  of  the  capacity 
lost  to  overhead. 

Van  de  Goor  (1970)  measured  a  number  of  overhead  factors  in  a  small 
time-sharing  system.  He  discovered  that  a  significant  portion  of  over¬ 
head  is  proportional  to  the  number  of  active  tasks  demanding  service  from 
the  system.  For  example,  both  paging  activity  in  a  virtual  memory  organiza¬ 
tion  and  many  monitor  list  searching  operations  are  proportional  to  the 
number  of  active  tasks.  The  mathematical  structure  of  a  finite  source, 
processor -shared  model,  allows  one  to  incorporate  overhead  loss  that  is 
proportional  to  the  number  of  active  tasks  in  the  system.  If  there  are 
m  active  jobs  demanding  service,  then  at  each  instant  every  task  will  seem 
to  have  its  own  virtual  processor  with  capacity  (l-f*m)*c/m  instructions 
per  unit  time.  To  keep  capacity  positive  the  overhead  less  fraction,  f, 
must  be  less  than  1/n  where  N  is  the  number  of  terminals  connected  to  the 
system. 

Each  of  the  N  input  terminals  is  an  exponential  source  with  rate  X. 
However,  once  a  terminal  has  submitted  a  job,  it  is  blocked  from  additional 
input  activity  until  the  computer  completes  its  request.  The  combined 
total  input  rate  for  all  terminals  that  do  not  have  requests  pending  is 
(N-m)*  X,  where  m  is  the  number  of  jobs  actively  using  the  processor.  All 
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service  requests  are  drawn  from  an  exponential  distribution  with  parameter 
v.  Thus  the  mean  service  request  is  l/v  instructions,  and  the  rate  at 
which  the  server  processes  jobs  is  v(l-f*m)*C.  An  important  feature  of 
this  type  of  model  is  that  it  is  stable  in  the  sense  that  the  input  rate 
decreases  as  the  number  of  tasks  demanding  service  increases.  Unlike 
the  models  in  the  previous  sections  where  the  queues  could  become  un¬ 
bounded,  this  structure  is  self  correcting,  and  a  steady  state  solution 
will  always  exist.  Figure  2.8  illustrates  the  basic  organization  of  the 
model . 

The  standard  method  of  solving  this  class  of  model  is  to  form  a  set 
of  differential  difference  equations  involving  system  state  variables. 

Let  Pm(t)  be  the  probability  that  there  are  m  active  tasks  in  the  processor 
at  time  t.  Since  all  of  the  individual  input  and  service  processes  are 
exponential  this  continuous -time  Markov  model  has  simple  state  transition 
probabilities.  For  example,  when  1  <  m  <  N  the  general  state  equation  is: 

(2.56)  P  *t+6)  =  (N-m+1) • X*  6 • ( 1 - f • (m-1) ) • v  C*  6) • P  .(t) 

m-l 

+  (l-(N-m) • X • 6) • (l-(l-f *m) • v O 6) • P  (t) 

m 

+  (1-f •  (m+1 ) ) • v»C*  6* ( 1- (N-m-1) *X*  6) • P  . ,  (t)  +o(62) 

m+l 

The  basic  principles  underlying  this  equation  are  that  if  interevent 
times  have  an  exponential  distribution  with  rate  y,  then: 

(a)  the  probability  that  an  event  will  occur  during  an  interval 


of  length  5  is  y*5,  and  the  probability  of  no  event  occurring 
is  (l-y-5) 
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(b)  if  there  are  k  such  processes  working  in  parallel,  then 

the  probability  that  an  event  will  occur  during  an  inter¬ 
val  of  length  6  is  k-y*6 


(c)  the  probability  of  two  or  more  events  occurring  during 

.  2. 

ft  is  of  the  order  of  6*6,  i.e.,  o(fi  ). 


The  next  steps  in  the  derivation  are  to  construct  similar  equations  for 
the  two  boundary  states  m=0  and  m=N,  and  take  the  limit  as  6  "*  0.  Let 
the  derivative  of  the  state  probability  with  respect  to  time  be  P^(t.) 


P  (t+6) -P  (t) 
m  m 

(2.57)  limit6  _  0  - g 


P’(t) 

in 


The  set  of  differential  difference  state  equations  becomes: 

(2.58)  (t)  =  -N*X*Pg(t)  +  (l'f)*v*C*P1(t) 

• 

P'(t)  =  (N-(m-l))*X‘P  ,(t)  -  {(N-m)  *X  +  (  1-m- f  h’CjT^t) 

m  m-i. 

+  (l-(m+l)*  f )  *v»C*  PjQ+i/t)  »  m=l»2>.».N-l 

P'(t)  =  X*P„  ,(t)  -  [(N-N) • X  +  (l-N*f)-v.C]»P  (t) 

N  N-l 

Statistical  equilibrium  (or  steady  state)  exists  when  the  state  probabili¬ 
ties  no  longer  change  with  time. 


(2.59)  lira,.  P'(t)  -  0 
v  t  -*  00  m 


t 


00 


P  (t)  = 
m 


P 

m 


(2.60)  lim 
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To  solve  for  the  equilibrium  state  probabilities,  one  lets  all 
p'(t)  =  0  and  then  uses  the  resulting  recursive  set  of  steady  state  equa- 

HI 

tions,  and  the  fact  that  the  sum  of  all  of  the  probabilities  is  unity,  to 

compute  all  values  of  P  .  Setting  all  P' (t)  to  zero  and  reworking  equa- 
r  m  m 

tion  (2.58)  by  substituting  the  result  for  Pffi  into  the  equation  for  Pm+1 
leads  to  the  following  set  of  steady  state  equations. 

(2.61)  (l-m-f)*v-C*Pm  -  (N-(m-l))-X*Pm_1,  ffl-1,2, . . .N  ,  f  <  1/n 

0  =  (N-N)-X*Pn 

Adding  all  terms  on  both  sides  of  this  set  of  equations  produces  the  follow¬ 
ing  expression. 

N  N  N  N 

(2.62)  v-C-  E  P  -  v-C-f-  E  m-P  *  N*X*  E  P  -  X-  E  mP 

.  m  _  m  m  __n  lu 

m=l  m=0  m=0  ra=U 

Substituting  equations  (2.63)  and  (2.64)  into  (2.62)  leads  to  (2.65),  the 
result  for  the  expected  value  of  the  number  of  tasks  demanding  service  from 
the  system,  E(M). 

N 

(2.63)  E(M)  =  E  m.P 

m-0  m 

N 

(2.64)  E  P  =  1  -  P0 

,  m  u 

m=l 

(2.65)  E(M)  =  iN-X  -  v.C.(l-P0)V(X-(v.C).f)  ,  f  <  l/N,  f 

Equation  (2.64)  and  the  set  of  equations  (2.61)  lead  to  the  derivation 
of  PQ,  the  probability  that  the  central  processor  is  idle.  All  of  the 
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other  state  probabilities  are  expressible  in  terns  of  P„ 


(2.66)  PL  =  N*X*  Pp/ {v*  C. (1-f) } 

P2  =  N.(N-l).X2.P0/[(vC)2.(l-f)(l-2f)} 


•  m 

Pm  =  pc  n  {(N-(i-l)).X/(vC-(l-i*f))],  m=l,2 . N 

i=l 


m 


where  II  X.  =  X. -X-'X,,..^ 

•  i  1  1  Z 


i=l 


3  m 


N  m 


(2.67)  PQ  =*  1/[1  +  ^  ^  {(^(i.ijj.^^.c.d-i.f))}] 


If  the  state  dependent  overhead  fraction,  f,  is  zero,  then  the  result  re- 

4 

duces  to  the  classic  formula  for  the  exponential  machine  repair  problem. 

To  express  mean  response  time  as  a  function  of  the  mean  number  in 
the  system  (equation  2.65)  one  may  use  the  equilibrium  argument  that  the 
mean  number  of  jobs  submitted  to  the  system  per  unit  time  must  equal  the 
mean  number  served  per  unit  time.  Each  of  the  N  terminals  goes  through 
many  cycles  of  generating  a  request  and  then  waiting  for  the  system  to 
respond  to  that  request.  The  mean  time  spent  in  the  first  part  of  this 
cycle  is  l/X  time  units  and  the  mean  time  spent  in  the  second  is  E(R) 
time  units.  Thus  the  mean  arrival  rate  from  each  terminal  is  l/(l/\+E(R)) 
and  the  total  mean  arrival  rate  to  the  system  is  N  times  this  quantity. 

The  service  rate  of  the  system  is  v*C*(l-m*f)  where  ro  is  the  number  of 

tasks  being  served. 

4 

See  Saaty  (1961),  p.  326. 
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(2.68)  N/(l/x+E(R))  =  O.P  +  vC  •£  (l-m.f).p 

°  m=l  m 

-  v«C« (1-Pg)  -  v«C*f.E(M) 

Another  way  of  looking  at  this  relation  is  to  note  that  when  there 
are  m  tasks  in  the  system  the  arrival  rate  from  the  remaining  terminals 
is  (N-m)-X  and  thus  the  mean  arrival  rate  is  (N-E(M)).X.  One  may  equate 
both  expressions  for  mean  arrival  rate. 

(2.69)  N/(1/X+E(R))  =  (N-E(M) )  *X 


By  using  equation  (2.65)  in  (2.68),  or  more  simply  by  solving  (2.69) 
for  E(R),  one  may  obtain  the  following  result  for  mean  response  time 
in  TSM0D3 .  Both  approaches  lead  to  the  same  result. 

(2.70)  E(R)  =  —MM) - 

X* (N-E(M) ) 


Figure  2.9  illustrates  mean  response  as  a  function  of  N,  the  number  of 
terminals  connected  to  the  processor,  for  a  number  of  values  of  f,  the 
overhead  loss  function. 


Each  of  the  models  developed  In  this  chapter  focusses  on  a  different 
aspect  of  current  implementations  of  time-shared  computing  systems.  The 
inherent  complexities  of  queueing  models  make  the  simultaneous  considera¬ 


tion  of  all  such  feature,  very  difficult.  The  next  two  chapters  present 
empirical  investigations  of  both  simulated  and  actual  systems.  Response 
time  measures  of  these  more  complex  systems  are  compared  with  the  predic¬ 
tions  of  the  analytic  model,  of  this  chapter.  Chapter  5  contains  a  number 
of  examples  of  how  one  may  use  these  models. 


E(R) 

con<*s  \  =»  l/l5  per  terminal 


63 


ri&uj-e  a. 9 

ean  Response  as  a  Function  of  tmr  Number  of  Terminals  -  TSM0D3 


-64- 


CHAPTER  3 

SIMULATION  STUDIES  OF  SYSTEM  BEHAVIOR 


3.1  INTRODUCTION 

The  results  of  Chapter  2  provide  new  expressions  relating  response 
time  measures  of  system  performance  to  parameters  such  as  overhead  loss, 
processing  capacity,  service  and  arrival  distributions,  and  interrupt 
probabilities.  To  keep  results  easy  to  compute,  these  analytic  models 
are  based  on  many  simplifying  assumptions  concerning  system  architecture 
and  user  behavior.  In  addition,  equation  (2.49),  the  least  complicated 
expression  for  mean  response  conditioned  on  service  request,  depends  on 
the  approximation  that  all  cycle  times  after  the  first  are  equal  to 
the  mean  number  of  tasks  in  the  system  multiplied  by  the  mean  quantum 
interval.  The  goal  of  this  chapter  is  to  explore  the  robustness  of  these 
results  when  they  are  applied  to  systems  that  do  not  satisfy  all  of  the 
assumptions.  The  following  experiments  range  from  simulations  closely 
related  to  the  analytic  models  of  Chapter  2  to  more  complex  designs  based 
on  features  of  an  operational  time-shared  systan. 

The  first  simulation  is  an  exact  model  of  Figure  2.1,  with  overhead 
and  quantum  times  both  having  truncated  normal  distributions  (both  were 
constrained  to  be  non-negative).  The  second  and  third  models  are  based 
on  a  tandem  queueing  structure  like  that  analyzed  in  Section  2.4.  The 
last  simulation  in  the  chapter  includes  a  detailed  model  of  the  schedul¬ 
ing  algorithms  of  TSS,  an  operating  system  for  the  IBM  360/67.  Task 
dispatching  in  this  system  includes  dynamic  priorities,  and  is  much  more 
complex  than  the  cyclic,  round  robin,  scheduling  of  the  previous  models. 
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The  goals  of  the  experiments  are: 

(a)  to  determine  how  well  the  equations  of  Chapter  2  predict 
performance  characteristics,  such  as  expected  value  of 
response  conditioned  on  service  request,  even  though  the 
models  differ  from  the  assumptions  underlying  the  previous 
derivations 

(b)  to  study  performance  characteristics  that  were  not  derived 
analytically  but  are  easy  to  examine  by  simulation  and 
which  lead  to  a  deeper  understanding  of  feedback  queueing 
systems 

(c)  to  determine  if  a  complex  model  based  on  an  operational 
system  exhibits  the  same  basic  characteristics  as  the 
simpler  models. 

3.2  EXPERIMENTAL  METHODOLOGY 

3.2.1  The  Simulations 

All  of  the  models  are  implemented  in  SIMULA,  a  general  purpose 
simulation  language  which  extends  ALGOL  in  a  number  of  important  dimen¬ 
sions.  In  addition  to  all  of  the  features  of  ALGOL,  the  language  pro¬ 
vides  good  list  processing  capabilities,  a  powerful  co-routine  capability 
including  a  full  range  of  process  scheduling  mechanisms,  and  a  number  of 
statistical  procedures.*" 

For  the  first  three  studies  each  experiment  consisted  of  a  100  task 
initialization  period,  in  which  statistics  were  not  gathered,  followed 

*"The  reader  interested  in  SIMULA  is  directed  to  Dahl  and  Nygaard  (1966), 
Univac  (1967),  and  McCredie  (1970). 
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by  a  production  period  in  which  statistics  were  calculated  for  1000 
tasks  passing  through  the  system.  Pilot  runs  produced  initial  estimates 
for  running  times  and  variances  of  the  sample  statistics.  Bach  experi¬ 
mental  run  of  the  first  study  required  approximately  10  seconds  of  Univac 
1108  processing  time.  Since  the  second  and  third  models  have  two  pro¬ 
cessing  subsystems  in  tandem  they  required  twice  as  much  computer  time 
per  simulation  as  the  initial  model.  To  simulate  the  processing  of  1000 
tasks  in  the  complex  model  described  in  Section  3.5  required  about  three 
or  four  minutes  of  1108  time.  As  a  result  of  the  expense  associated 
with  the  detail  of  this  model,  only  a  few  experiments  were  performed. 

Each  run  represents  an  independent  set  of  statistics  since  the 
models  were  initialized  with  different  starting  seeds  for  random  number 
generators,  and  all  statistical  counters  were  reset  to  zero.  The  initiali¬ 
zation  period  to  remove  startup  transients  preceded  each  run.  Appendix  B 
contains  listings  of  the  simulations  used  for  the  studies. 

3.2.2  The  Statistical  Analysis 

One  must  use  statistical  tools  to  analyze  data  from  stochastic 

systems.  A  striking  characteristic  of  the  data  from  the  simple  queueing 

structures  of  Sections  3.3  and  3.4  is  its  high  variance.  The  estimators 

used  to  determine  model  variables  come  from  independent  experiments.  Label 

the  value  of  an  estimator  from  simulation  run  i,  X^.  Each  independent 

2 

is  drawn  from  a  population  having  a  finite  mean  p,  and  variance  a  .  An 
estimator  of  y,  is  the  sample  average  X,  which  is  based  on  all  of  the  ex¬ 
periments  and  is  itself  a  random  variable.  In  Section  3.3  and  3.4  each 
study  consists  of  20  independent  experiments  (n  =  20). 
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(3.1)  X  =  E  X. 

n  i=l  1 

The  population  variance,  a  ,  for  each  variable,  is  unknown  in  the  experi¬ 
ment,  but  one  may  use  the  following  estimator  of  it. 

(3.2)  s2  =  -L-  E  (X  -X)2 

0-1  i=l  1 

To  scale  X  so  that  it  has  a  mean  of  zero  and ^ variance  of  unity, 
subtract  p,  from  X  and  divide  the  result  by  (s2/n)2. 

1  1 

(3.3)  Z  =  (X-p,)/(s2/n)2  =  (n)\x-^)/s 

The  central  limit  theorem  states  that  Z  becomes  normally  distributed  with 
mean  0  and  variance  1  as  n  becomes  large.  Z  does  not  have  a  normal  dis¬ 
tribution  for  small  n  because  it  is  based  on  the  random  variable  s2,  an 
2 

estimate  of  a  .  Z  has  a  Student-t  distribution  which  deviates  from  the 

Normal  distribution  for  small  values  of  n,  but  approaches  the  Normal 

o 

when  n  is  large  (e.g.,  n  >  30). 

One  may  form  a  confidence  interval  for  sample  averages  by  locating 
points  which  partition  a  desired  percent  of  the  area  under  the  density 
function  for  the  Student-t  distribution.  For  example,  one  may  compute  the 
probability  that  an  interval  based  on  sample  statistics  covers  the  true 
mean,  p,.  Using  the  Student-t  distribution  with  n-1  =  19  degress  of  freedom, 
one  finds  that  in  these  experiments  the  probability  is  .95  that  the  interval 
of  equation  (3.4)  will  contain  the  true  mean,  p,. 

2 

See  Mood  and  Graybill  (1963),  pp.  251-253  for  a  discussion  of  the  estima¬ 
tion  of  mean  values  when  the  variance  is  not  knowr  and  pp.  149-153  for  a 
discussion  of  the  central  limit  theorem. 


-68- 


1  1 
(3.4)  X  -  2.09*  (s2/n)2  ^  p,  *  X  +  2.09-(s2/n)2 

3.3.  A  SIMULATION  OF  TSMODl 

3.3.1  The  Model 

TSMODl,  the  feedback  queueing  model  studied  in  Section  2.3  and  illus¬ 
trated  in  Figure  2.1,  is  the  subject  of  the  first  validation  experiment. 
The  following  parameters  were  used  in  the  study: 

F  (t)  =  F  (t)  ~  normal  distributions  (mean=.05,  o=.015) 

W  D 

wl/c  =  dl  =  p  =  .05  seconds 
w2/c2  =  d2  =  a2+(p,)2  =  .002725  (seconds)2 
w3/c3  =  d3  =  (p)3+3*p,*a2  =  .  00015875 (seconds) 3 
Processing  rate  =  C  =  1  instruction/microsecond 
Arrival  rate  =  X  =  1  job/second 

Probability  job  leaves  after  an  interrupt  -  1=  l/ 8 
The  statistical  estimators  used  to  summarize  the  data  are: 


(3.5)  R  =  the  sample  average  of  response  times 
1  n 

=  -•  E  R. 

n  i=l  1 


where  R  =  (time  task  i  leaves  the  system  -  time  task  i 
i 

entered  the  system) 


SD(R)  =  the  cample  standard  deviation  of  response  times 

1 

1  n  ?  ) 

■  ta-s  <V*>  5 

1=1 


(3.6) 
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(3.7)  t^  =  the  sample  average  of  the  time  spent  waiting  until 

a  task  receives  its  first  processing  quantum 
1  n 

■  —  *  E  (time  task  i  waits  before  beginning  its  first 
”  i=l 

processing  quantum) 

(3.8)  P0*100  =  the  percentage  of  time  the  processor  was  idle 

=  100  •  (time  processor  idle/ total  simulated  time) 

(3.9)  B  =  least  squares  estimate  of  slope  of  response  time  as 

a  function  of  service  request  (where  v^  is  service 

request  of  the  i^  task) 

n  n  n  n  2  n  2 

=  In  •  T  R.-v  -  E  R  ‘  E  v  }/  [n  •  E  v  -  (Ev  )  j 

i-1  11  i-1  1  i»l  1  i=l  1  i=lA 

The  analysis  of  Section  2.3  presents  exact  solutions  for  the  expected 
values  of  R  (equation  2.24),  SD(R)  (equation  2.19),  (equation  2.31), 
and  P0  (equations  2.10  and  2.16).  Equation  (2.49)  is  an  approximate  ex¬ 
pression  for  the  expected  value  of  response  time  conditioned  on  service 
request.  This  equation  contains  a  parameter  B  which  is  the  slope  of  the 
conditional  response  time.  The  approximation  is  based  on  the  assumption 
that  the  service  request,  V,  is  an  exponentially  distributed  random  vari¬ 
able,  and  on  the  mathematical  simplification  that  all  cycle  times  after 
the  first  are  equal  to  the  mean  number  of  tasks  in  the  system  multiplied 
by  the  mean  quantum  interval.  The  next  section  contains  comparisons  of 
the  results  of  the  simulations  of  TSMODl  with  the  analytic  expressions  for 


these  variables. 
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3.3.2  The  Results 

Table  3.2  presents  all  of  the  experiemtnal  results  for  each  of  the 

five  variables  for  20  independent  runs,  each  of  which  represents  1000 

observations  obtained  after  an  initialization  period  of  100  tasks.  The  ^ 

2  2  2 

experimental  values  are  combined  to  form  the  estimators  X,  s  ,  s,  (s  /20) 
defined  by  equations  (3.1)  and  (3.2).  Table  3.1  summarizes  this  data  by 
presenting  the  95  percent  confidence  interval  from  the  experimental  data 
and  the  analytic  result  from  Chapter  2  for  each  of  the  five  variables. 

All  of  the  analytic  results  lie  within  the  confidence  intervals.  The 
samples  display  the  high  variance  inherent  in  queueing  systems  of  this 
type.  This  particular  sample  exhibits  slightly  heavier  congestion  than 
predicted  by  the  analytic  solution.  For  example,  runs  six  and  ten  are 
very  heavily  congested  experiments.  Figure  3.1  is  a  typical  histogram  of 
response  times  in  TSMODl. 


Variable 

95  percent  confidence 
interval  fsee  eq.  (3.4)} 

Sample 

Average 

Analytic 

Result 

R 

3.35 

s; 

E(R)  s;  4.51 

3.93 

3.81 

SD(R) 

4.47 

SD(R)  £  6.31 

5.39 

5.58 

P0-100 

17.38 

pQ  •  100  S  20.43 

18.90 

20.00 

h 

.34 

£ 

E(tx)  £  .47 

.41 

.39 

B 

8.33 

£ 

E(B)  £  11.28 

9.81 

8.54 

TABLE  3.1 

Comparison  of  Experimental  and  Analytic  Values  for  TSMODl 
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Table  3.2 

Simulation  Results  for  Experiments  on  TSM0D1 
(Input  parameters  are  displayed  in  Section  3.3.1) 
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Figure  3.1 

Histogram  of  Response  Times  for  TSMODl 
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The  analysis  of  Section  2.3  predicts  a  nearly  linear  relationship 

between  service  request  and  mean  response.  To  test  this  result,  each 

task  recorded  both  its  service  request  and  its  transit  time  through  the 

system.  These  data  were  separated  into  equal  service  intervals  (and 

an  additional  overflow  interval)  and  processed  to  calculate  mean  job 

response  for  each  interval.  Table  3.3  displays  the  average  response, 

and  the  number  of  observations  on  which  it  is  based,  for  five  service 

intervals  for  the  20  experimental  runs.  Results  for  the  X,  s2,  s,  and 
2  2 

(s  /n)  are  also  displayed. 

Figure  3.2  is  a  graph  of  the  data  of  Table  3.3.  Each  point  is  the 
sample  average  of  the  observations  in  that  interval,  and  is  placed  at  the 
mid  point  of  the  service  interval.  The  vertical  bars  through  each  point 
represent  the  sizes  of  the  95  percent  confidence  intervals  computed  using 
equation  (3.4).  The  solid  line  connects  the  sample  averages  and  the  two 
broken  lines  form  an  area  in  which  the  true  value  of  mean  response  con¬ 
ditioned  on  service  request  lies  with  95  percent  confidence.  The  increas¬ 
ing  variance  with  service  comes  from  two  factors:  (a)  the  number  of 
observations  decreases  in  the  intervals  having  higher  values  of  service 
and  (b)  variance  of  response  increases  with  service  request.  Thus  long 
jobs  experience  longer,  and  more  highly  variable,  response  than  short 


jobs . 
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3.4  A  SIMULATION  OF  TSMOD2 

3.4.1  The  Models 

TSMOD2  is  similar  to  TSMODl  with  an  additional  processing  system 
after  the  central  processing  unit.  This  extra  queueing  subsystem  repre¬ 
sents  an  input/ lutput  (i/o)  system  for  program  swapping,  paging,  and 
file  handling.  Figure  2.  5  illustrates  the  structure  and  Section  2.4 
includes  an  analysis  of  the  model  when  the  service  times  in  both  systems 
are  exponential.  This  section  includes  simulations  of  two  versions  of 
TSM0D2.  In  the  first  (which  is  identical  to  the  model  of  Section  2.4) 
both  the  processor  and  the  i/o  systems  have  exponential  service  distribu¬ 
tions  and  there  is  no  explicit  overhead  delay.  In  the  second,  the  pro¬ 
cessor  is  identical  to  TSMODl  (an  overhead  delay  and  then  a  processing 
quantum)  and  the  i/o  processor  has  a  uniform  service  distribution  which 
is  more  representative  of  rotating  external  storage  devices  than  an  ex¬ 
ponential  distribution.  The  following  parameters  were  used  for  these 
two  models : 


Server  1 


Version  I 

Exponential  distribution 
with  rate  10  jobs/second. 
No  overhead. 


Version  II 

Overhead  and  service 
quanta  both  have  Normal 
distributions  with 
mean  =  .05  seconds  and 
standard  deviations  = 
.015  seconds  (rate  = 

10  jobs/ second) 


Server  2  Exponential  distribution  Uniform  distribution  be 

with  rate  10  jobs/second.  tween  0.0  and  .2  second 

(rate  =  10  jobs/second) 


System  arrival  rate=  1  job/ second 

X  i  1 

Probability  job  leaves  g 

after  an  .interrupt  =  l 


1  job/ second 


1 

8 
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The  statisitical  estimators  used  to  summarize  the  data  are: 

R  =  sample  average  of  response  time  (previously  defined) 

SD(R)  =  sample  standard  deviation  of  response  time  (previously  defined) 
(3.10)  =  sample  average  of  number  of  tasks  in,  and  waiting  in  queue 

for,  server  1 
1  .T 

=  —  J  (number  in  queue  1  +  number  in  server  1)  dt 
T  0 

where  T  is  the  simulated  time  interval  of  the  experiment 

^2  =  same  definition  as  except  that  queue  2  and  server  2 

replace  queue  1  and  server  1 

B  =  least  squares  estimate  of  slope  of  conditional  response 

time  (previously  defined) 

Section  2.4  contains  exact  expressions  for  the  expected  values  of 
and  M  (equation  2.52),  and  for  the  mean  value  of  B  (equation  2,55). 

The  unconditional  mean  response  time,  E(R),  may  be  obtained  from  equa¬ 
tion  (2.55)  by  remaining  the  condition  on  V.  Since  this  equation  is 
linear  in  v,  one  simply  replaces  v  with  its  expected  value  F,(V).  The 
results  of  Version  I  verify  this  analysis  and  provide  insight  into  the 
variability  of  the  results.  Version  II  is  included  to  test  the  effects 
of  changing  the  distributions  of  the  overhead  delay  and  the  processing 
requests.  The  next  section  contains  comparisons  of  these  two  versions 
of  TSM0D2  with  each  other  and  with  the  analytic  expressions  of  Section 


2.4. 
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3.4.2  The  Results 

The  results  of  the  simulations  of  TSM0D2  are  presented  in  a  manner 
similar  to  that  of  Section  3.3.  Table  3.4  summarizes  the  results  of 
Version  I  by  presenting  the  95  percent  confidence  intervals  for  the 
data  and  the  analytic  results  from  Section  2.4  for  these  variables. 

Table  3.5  displays  the  results  for  each  of  the  variables  for  the  20  ex- 
periemntal  runs  of  TSM0D2  -  Version  I.  As  in  the  previous  section,  each 
run  represents  1000  observations  obtained  after  an  initialization  period 
of  100  tasks.  All  of  the  analytic  results  lie  within  the  confidence 
intervals.  To  test  the  prediction  of  a  linear  relationship  between 
service  request  and  mean  response,  each  task  again  recorded  both  its 
service  request  and  its  transit  time  through  the  system.  Table  3.6  con¬ 
tains  the  results  of  separating  the  service  requests  into  equal  intervals 
and  calculating  the  sample  averages  for  each  interval.  Figure  3.3  is 
a  graph  displaying  this  data  and  the  95  percent  confidence  intervals 
for  response  as  a  function  of  service  request. 


Variable 

95  percent  confidence 
interval  |see  eq.  (3.4)1 

Sample 

Average 

Analytic 

Result 

“l 

3.58  £  E(M1)  £  4.29 

3.94 

4.00 

*2 

3.59  £  e(M2)  £  4.45 

4.02 

4.00 

R 

7.24  £  E(R)  £  8.61 

7.93 

8.00 

B 

7.89  £  E(B)  <:  9.20 

8.55 

8„  88 

Table  3.4 

Comparison  of 

Experimental  and  Analytic  Values 

for  TSM0D2 

-  Version 

Experiment  R  SD(R) 
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(Input  parameters  are  displayed  in  Section  3.4.1) 
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Table  3.7  contains  the  experimental  results  for  TSM0D2  -  Version  II. 
Each  run  represents  1000  observations  obtained  after  an  initialization 
period  of  100  tasks.  To  test  the  prediction  of  a  linear  relationship  be¬ 
tween  response  and  service  request  each  task  again  recorded  both  its 
service  request  and  its  transit  time  through  the  system.  Table  3.8  con¬ 
tains  the  sample  averages  of  response  time  for  various  service  request 
intervals  and  the  number  of  data  points  in  each  interval.  Figure  3.4 
is  a  graph  of  this  data  including  the  95  percent  confidence  intervals  for 
response  time  as  a  function  of  service  request. 

TSMOD2  -  Version  II  differs  in  a  number  of  ways  from  Version  I.  Since 
neither  the  central  processor  nor  the  l/o  system  have  exponential  service 
distributions,  the  outputs  and  thus  the  resultant  inputs  to  both  systems 
are  not  Poisson.  Both  service  distributions  have  a  coefficient  of  varia¬ 
tion  less  than  an  exponential  and  thus  the  outputs  from  the  servers  are 
more  regular  than  from  a  Poisson  process.  This  increased  regularity  of 
service  and  input  pi  >cesses  reduces  both  the  congestion  in  the  system  and 
response  times.  The  analysis  based  on  exponential  input  assumptions  over¬ 
states  congestion.  Queueing  theory  offers  little  help  in  the  analysis  of 
non-Poisson  queues  in  tandem.  For  example,  if  the  methods  of  Section  2.4, 
in  which  each  subsystem  is  treated  as  an  independent  queueing  system,  are 
applied  to  this  example  and  both  subsystems  are  treated  as  independent 
M/G/l  queues  (with  Poisson  input  rate  =  8)  the  mean  number  in  each  sub¬ 
system  would  be  E(MX)  =  3.809  and  E(M2>  =  2.933.  The  simulation  results 
show  these  valuer7  to  be  =  2.60  and  M2  =  2.38^  or  about  25  or  30  percent 
less  than  predicted  by  an  m/g/1  model.  This  example  indicates  how  non¬ 
radical  changes  in  modeling  assumptions  may  force  the  analyst  to  switch 
from  analytic  techniques  to  simulations  to  get  more  accurate  estimates  of 
system  parameters.  Note,  however,  that  the  linear  relationship  between 
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Table  3.7 

Simulation  Results  for  Experiments  on  TSM0D2  -  Version  II 
(Input  parameters  are  displayed  in  Section  3.4.1) 
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response  and  service  request,  which  was  derived  on  the  basis  of  the 
assumptions  of  Version  I,  holds  for  Version  II.  Both  models  exhibit 
the  same  general  behavior  as  the  input  rates  increase,  or  as  one  sub¬ 
system  changes  its  processing  capacity  relative  to  the  other. 

3.5  A  SIMULATION  OF  SCHEDULING  IN  TSS/360 

3.5.1  The  Mod  ;1 

TSS/360  is  a  time-sharing  operating  system  for  the  IBM  360  Model  67. 
(IBM,  1968).  This  computer  differs  from  the  standard  360  line  because  of 
hardware  additions  designed  to  create  a  virtual  memory  addressing  struc¬ 
ture  utilizing  segments  and  pages  .  Section  5.3  contains  an  elementary 
discussion  of  paging.  The  interested  reader  is  directed  to  Wilkes  (1968) 
and  Denning  (1970)  for  excellent  treatments  of  the  subject. 

The  algorithm  which  schedules  and  dispatches  tasks  in  this  multi- 
programmed,  time-shared  environment  is  a  section  of  TSS  called  the  table 
driven  scheduler.  Since  each  TSS  system  has  a  different  user  community 
to  bn l Lsfy ,  and  a  different  hardware  configuration,  the  parameters  in 
the  table  driven  scheduler  may  be  set  by  each  installation.  Many  parameters 
within  the  table  are  branching  codes  to  other  sections  of  the  table.  The 
scheduling  section  of  this  simulation  is  much  more  detailed  than  other 
subsystems  such  as  the  paging  disks.  This  model  is  also  implemented  in 
SIMULA.  Appendix  C  contains  a  listing  of  the  program. 3 

McCredie  and  Schlesinger  (1970)  describe  the  structure  of  the  model 
in  more  detail  than  is  required  here.  One  goal  of  the  design  was  to  show 
that  a  useful  model  can  be  easily  implemented  without  detailed  modeling 
of  all  system  components.  Different  system  modules  have  vastly  different 
3~  : 

This  program  was  designed  jointly  by  J.  McCredie  and  S.  Schlesinger.  S. 
Schlesinger  implemented  and  debugged  the  version  presented  in  Appendix  C." 
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levels  of  detail  in  the  simulation,  and  the  areas  of  detail  may  change 
as  the  model  evolves.  Elements  of  the  physical  system  were  included  onlv 
when  necessary  because  of  interactions  with  the  scheduler.  The  primary 
goal  of  the  study  was  to  obtain  measures  of  response  times  experienced 
by  interactive  users.  Figure  3.5  illustrates  the  model's  structure. 

Three  hardware  facilities  appear:  the  CPU,  the  paging  devices, 
and  memory.  The  CPU  appears  implicitly  in  all  software  elements  of  the 
system  and  in  the  execution  of  user  programs.  No  CPU  characteristics 
such  as  clock  cycle  time  or  instruction  times  are  included,  although 
they  are  implicit  in  the  amount  of  computation  time  used  by  user  programs. 

Two  types  of  paging  devices  are  included  in  the  model:  disks  and 
drums.  Disks  are  viewed  as  an  infinite  source  of  new  pages  demanded  by 
executing  programs  and  as  an  infinite  storage  facility  for  pages  written 
out  by  the  monitor.  Actual  operation  of  these  units  is  complex  since 
arm  seeks  on  different  spindles  can  be  overlapped,  and  software  disk 
management  routines  try  to  optimize  arm  movements  to  maximize  the  flow 
of  pages  into  core.  Instead  of  modeling  this  process  directly,  the 
access  time  of  a  page  is  drawn  from  a  distribution.  The  statistical 
characteristics  of  this  distribution  reflect  the  operation  of  the  actual 
system.  The  parameters  of  the  distribution  were  determined  by  observa¬ 
tions  from  system  logging  information.  Drums  are  represented  by  their 
revolution  times  and  their  capacity  in  pages.  The  distribution  of  access 
times  for  pages  from  a  drum  is  uniform  from  zero  to  the  revolution  time. 

There  are  two  major  software  routines  in  the  model  -  the  timer  inter 
rupt  handler  and  the  table  driven  scheduler.  Minor  software  functions 
occur  implicitly  in  other  parts  of  the  model.  A  timer  interrupt  occurs 


FIGURE  3.5 

TSS/360  Model  Structure 
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when  a  user  program  has  CPU  control  at  the  end  ol  its  time  quantum.  The 
interrupt  handler  may,  depending  on  the  program's  scheduling  parameters, 
do  any  of  the  following:  force  a  time-slice  end  and  write  pages  onto  the 
disk  (or  drum);  change  the  scheduling  parameter a;  give  the  program  an 
additional  time  quantum.  The  timer  routine  in  the  model  performs  the  func¬ 
tions  of  several  subroutines  of  TSS/360  which  are  called  when  a  timer 
interrupt  occurs. 

The  table  driven  scheduler  is  the  most  detailed  portion  of  the  simula¬ 
tion.  Each  program  in  the  system  is  assigned  an  entry  in  the  schedule 
table.  This  entry  contains  maximum  limits  on  CPU  usage  and  paging  activity 
of  a  program.  A  program  exceeding  the  limits  is  penalized  by  loss  of 
eligibility  for  CPU  allocation  and  possible  lowering  of  priority.  This 
penalty  occurs  by  changing  the  program's  schedule  table  entry  to  a  new 
one  depending  upon  how  the  progran  exceeded  the  bounds  of  its  previous 
entry.  For  each  maximum  there  is  a  new  schedule  table  entry  to  which 
the  program  will  be  assigned  if  that  limit  is  exceeded.  The  monitor  inter¬ 
rupts  a  program  during  its  time  slice  to  check  if  any  bounds  have  been 
violated. 

The  scheduler  maintains  several  lists  of  programs,  each  one  having 
a  different  eligibility  for  CPU  allocation.  User  programs  move  among  the 
lists  depending  on  their  schedule  table  entry  and  operating  characteristics. 

The  schedule  table  in  the  actual  system  has  limits  on  additional  operating 
characteristics  of  programs  to  enable  fine-tuning  of  the  scheduling  algorithm. 

Frogram  behavior  is  characterized  by  periods  of  CPU  usage  separated 
by  page  faults.  When  the:  proyram  receives  CPU  control  from  the  scheduler 
it  is  interrupted  only  by  a  timer  interrupt  or  page  fault.  While  it  has 
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CPU  control,  no  classification  is  made  of  language  used,  system  functions 
called,  or  other  modes  of  activity.  The  only  parameter  of  interest  during 
CPU  usage  is  the  time  necessary  to  complete  the  user  request.  Paging 
activity  is  based  upon  the  working  set  concept  of  Denning  (1968).  Each 
request  specifies  the  working  set  size  for  that  request.  The  user  pro¬ 
gram  then  calls  for  sufficient  pages  to  fill  the  working  set.  There  is 
no  distinction  concerning  the  contents  of  each  page.  Only  the  number  in 
core  is  of  interest. 

The  users  in  the  model  make  terminal  requests  and  wait  for  system 
response  at  the  terminal.  A  request  consists  of  the  amount  of  CPU  time 
required  and  the  number  of  new  pages  which  have  to  be  brought  into  core 
for  a  complete  working  set.  Hie  model  draws  both  of  these  parameters 
from  distributions  either  approximating  observed  system  behavior  or  test¬ 
ing  hypothetical  modes  of  system  use.  The  distribution  of  response  time 
experienced  by  a  user  is  the  statistic  of  primary  interest. 

3.5.2  The  Results 

A  modular  simulation  such  as  the  one  described  in  the  preceding  sec¬ 
tion  gives  a  systems  analyst  a  great  deal  of  flexibility.  The  original 
goal  of  the  model  was  to  aid  in  tuning  TSS/360  to  the  job  load  of  the 
CMU  environment.  The  first  use  of  the  simulation  involved  a  group  of 
users  who  proposed  paying  a  higher  rate  to  receive  better  service  from 
the  system.  The  plan  designed  to  achieve  this  service  differential  was 
to  create  an  algorithm  in  the  schedule  table  so  that  users  from  the 
higher  priority  class  would  follow  a  different  path  through  the  schedule 
table.  Tests  using  the  model  indicated  that  benefits  of  the  proposed 
solution  were  marginal  compared  to  the  increased  charge.  A  different 
plan,  based  upon  the  concept  of  guaranteed  terminal  access  to  a  certain 
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Model  of  TSS/360  -  Heavy  Usage  Script 
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Model  of  TSs/360  -  Probe  Job  in  Normal  Mi 
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number  of  higher  priority  users,  provided  the  required  service  differen¬ 
tial. 

Ihe  model  may  be  used  like  the  previous  ones  in  this  chapter  to 
measure  both  the  mean  value  of  response  times  for  various  loadings  and 
the  mean  response  time  conditioned  on  service  request.  Figures  3.6  and 
3.7  are  typical  graphs  of  such  experimental  results.  The  first  is  a 
heavily  loaded  system,  and  the  second  is  more  representative  of  a  typical 
user  load.  Results  from  this  model  of  TSS/360  have  the  same  global  char¬ 
acteristics  as  the  results  from  the  analytic  models  of  Chapter  2. 

Mean  response  conditioned  on  service  request  is  a  linear  function  of  the 
service  request,  and  severe  response  degradation  occurs  with  heavy  loading. 

3.6  DISCUSSION 

The  examples  of  this  chapter  illustrate  some  of  the  advantages  and 
disadvantages  oi  siiui1'  :’.tion  as  a  tool  for  the  analysis  of  computer  systems 
Flexibility  is  demonstrated  by  the  ease  with  which  these  models  may  be 
modified  incrementally  to  examine  the  effects  of  changes  such  as  new  dis¬ 
tribution  assemptions  or  the  addition  of  another  processing  subsystem  for 
input  and  output  activity.  Appendix  B  contains  the  listing  for  TSM0D2 . 

To  use  this  program  to  study  TSMODl,  one  removes  the  activity  describing 
the  i/o  system,  and  changes  a  few  lines  of  code  in  the  activity  describing 
the  central  processor.  Appendix  E  contains  a  listing  of  the  program  used 
to  study  different  dynamic  control  algorithms  for  time-shared  systems.  The 
program  used  to  study  TSM0D2  is  also  the  basis  for  this  latter  model.  The 
dynamic  control  algorithm,  and  the  user  behavior  model,  were  easily  added 
to  the  original  design.  The  model  of  TSS/360  which  is  listed  in  Appendix  C 
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also  illustrates  the  flexibility  of  a  modular  approach  to  simulation. 

Once  implemented  and  debugged,  a  well  designed  simulation  can  be  a  very 
powerful  aid  to  system  analysis. 

Large  simulations  are  expensive  to  implement  and  to  run.  The  data 
in  the  previous  sections  illustrate  the  variability  which  is  inherent  in 
queueing  processes.  To  properly  analyze  the  results  of  experiments  on 
models  of  such  systems,  one  must  make  many  experimental  runs.  Since  each 
experiment  is  only  one  realization  of  a  stochastic  process,  it  can  become 
expensive  to  produce  tightly  bounded  estimates  of  the  values  of  state 
variables. 

The  primary  goal  of  this  chapter  was  to  examine  the  robustness  of 
the  analytic  models  developed  in  Chapter  2.  When  the  simulations  are 
closely  related  to  the  analytic  models,  the  analytic  results  are  within 
the  confidence  intervals  determined  by  the  experiments.  In  addition,  the 
global  behavior  of  more  complex  systems  such  as  TSM0D2 -Version  2  and 
TSS/360  has  the  characteristics  predicted  by  the  analytic  models.  The 
next  chapter  presents  the  results  of  three  empirical  investigations  of 
operational  time-shared  computing  systems. 


-94- 


CHAPTER  4 

EMPIRICAL  STUDIES  OF  SYSTEM  BEHAVIOR 

4 . 1  INTRODUCTION 

Although  the  models  of  Chapter  2  include  important  features  often 
neglected  in  other  models,  they  are  simple  structures  when  compared  with 
actual  computer  systems.  The  simulation  studies  of  the  previous  chapter 
illustrate  a  number  of  properties  of  feedback  queueing  structures,  and 
demonstrate  that  more  complex  models  exhibit  the  same  basic  behavior  pat¬ 
terns  as  the  simpler  analytic  structures.  The  purpose  of  this  chapter 
is  to  present  empirical  evidence  that  one  may  describe  macroscopic  per¬ 
formance  measures  of  actual  systems  with  these  same  analytic  formulations. 
The  models  capture  enough  of  the  essential  features  of  actual  designs 
to  enable  one  to  use  them,  as  outlined  in  Section  1.1  and  illustrated 
in  Chapter  5,  in  systems  analysis  studies. 

There  are  many  different  ways  to  measure  and  evaluate  the  performance 
of  computing  systems.  Perhaps  the  oldest,  and  most  common,  technique  is 
the  execution  of  a  representative  set  of  programs  (called  a  benchmark 
series)  while  monitoring  the  system.  The  development  of  a  benchmark 
series  which  accurately  models  the  characteristics  of  a  particular  user 
community  is  a  difficult  problem  that  is  not  adequately  solved.  An  ad¬ 
ditional  problem  is  that  a  computing  system  can  usually  be  tuned  to  do 
well  on  any  specific  benchmark  series.  However,  the  purpose  of  the  ex¬ 
periments  which  follow  is  not  to  compare  and  evaluate  different  systems 
for  a  particular  environment,  but  rather  to  explore  their  general  behavior 
and  compare  it  with  that  predicted  by  the  models  of  Chapter  2. 


-95- 


A  representative  benchmark  series  is  particularly  hard  to  create 
for  a  time-shared  system  that  is  to  support  many  independent  users.  A 
method  which  is  related  to  the  standard  benchmark  technique  is  a  user 
population  simulator  which  creates  pseudo  user  tasks  which  follow  a 
script  with  precise  inter-command  timing  delays.  This  procedure  is  an 
important  evaluation  technique  because  of  its  high  degree  of  repeatability. 
TVo  common  ways  of  implementing  it  are  to  dedicate  a  second  computer  to 
the  task  of  simulating  the  user  population  or  to  create,  within  the  system 
being  measured,  a  special  program  that  interfaces  with  the  operating  sys¬ 
tem  and  is  capable  of  inserting  user  jobs  into  the  task  queue.  Special 
programming  systems  are  required  for  this  technique. 

An  alternative  design,  which  was  used  for  the  first  experiment, 
makes  use  of  people  who  follow  a  benchmark  script.  The  purpose  of  this 
design  is  to  create  a  semi-controlled  environment  in  which  users  can 
run  pre-designed  programs  and  experience  realistic  system  response.  The 
experiment  was  non-repeatable  at  the  instruction  level  since  users  were 
not  synchronized  or  driven  by  any  timing  information,  but  this  type  of 
precision  was  not  required  for  the  global  performance  measures  of  interest 
m  this  chapter.  An  advantage  of  this  semi-controlled  design  is  that 
actual  user  behavior  does  not  have  to  be  modeled.  Real  users  type  at  dif¬ 
ferent  speeds  with  different  accuracy.  To  use  a  user  population  simulator 
one  must  design  a  script,  and  an  explicit  model  of  the  behavior  of  all 
users.  Thus  in  the  semi -controlled  environment  one  trades  a  gain  in 
realism  for  a  loss  in  repeatability.  Another  reason  for  using  the  semi- 
controlled  environment  was  that  the  response  time  investigations,  reported 
in  the  next  sections,  were  but  one  dimension  of  a  larger  investigation  of 
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properties  of  different  time-sharing  systems.  In  the  larger  study, 
qualitative  judgments  of  users  along  dimensions  such  as  ease  of  use, 
perceived  power,  and  reliability  were  important. 

A  disadvantage  of  both  of  the  experimental  techniques  discussed  so 
far  is  that  to  observe  the  system  in  a  realistic  mode  of  operation  one 
must  create  a  script  which  is  a  good  approximation  to  user  behavior. 

An  alternative  procedure  is  to  measure  the  system  during  an  actual  user 
session.  One  may  treat  the  computer  and  its  user  community  as  one  large 
system  to  be  measured  by  inserting  a  probe  task  with  known  characteristics 
into  the  job  queue  and  monitoring  its  behavior.  An  advantage  of  this 
technique  is  that  if  the  probe  job  does  not  use  a  great  many  resources, 
measurements  can  be  made  during  actual  user  sessions  without  causing 
severe  degradation  to  other  users. 

The  following  experiments  include  the  monitoring  of  both  an  operational 
IBM  360/67  using  TSS/360  and  a  Uni vac  1108  using  EXEC-8.  In  the  first 
experiment,  a  set  of  users  followed  a  script  which  directed  their  inter¬ 
actions  with  TSS/360  while  the  system  calculated  and  saved  response  statis¬ 
tics.  For  the  second,  a  small  probe  job  was  inserted  into  the  actual 
user  environment.  This  probe  entered  the  360/67  at  random  intervals  over 
a  period  of  a  number  of  weeks,  measured  selected  state  variables,  and 
gathered  statistics  about  its  own  response.  The  last  experiment  was 
similar  to  the  first,  but  it  was  performed  on  the  1108  using  EXEC-8.  Thus 
the  same  basic  experiment  was  conducted  on  two  very  different  systems,  and 
two  different  types  of  experiments  were  performed  on  one  of  the  systems. 

The  following  sections  contain  a  more  detailed  discussion  of  each  of  the 
experiments  and  their  results. 
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4.2  EXPERIMENTS  ON  TSS/360 
4.2.1  Controlled  User  Script 

The  computer  used  was  the  Carnegie-Mellon  IBM  360/67  using  TSS/360 
Version  5.1.  The  experiment  was  run  during  the  spring  of  1970  when 
Carnegie  was  using  a  memory  hierarchy  which  included  IBM  large  capacity 
storage  (LCS)  which  had  a  relatively  slow  cycle  time  of  eight  microseconds. 

For  this  experiment  29  selected  TSS  users  received  a  short  training 
session  in  which  they  were  introduced  to  both  the  goals  of  the  study  and 
the  script.  The  computer  was  dedicated  to  the  experiment  for  approximately 
two  hours.  Users  not  participating  in  the  study  were  denied  access  to 
the  system.  Participants  had  special  account  numbers  valid  only  for  the 
study.  All  background  batch  computing  was  terminated  so  that  only  the 
script  tasks  submitted  from  terminals  would  be  active. 

Figure  4.1  is  a  block  diagram  of  the  script,  and  Appendix  D  contains 
a  complete  listing  of  the  script.  After  establishing  a  connection  with 
the  computer  each  user  performed  initialization  tasks  which  gave  him  ac¬ 
cess  to  required  programs  and  which  created  necessary  statistical  files. 

The  initialization  program  called  the  FORTRAN  compiler  and  directed  it 
to  process  TESTl.  There  were  two  small  intentional  errors  in  this  source 
code  and  each  person  then  used  the  editor  to  correct  these  statements  and 
list  the  program.  After  the  program  was  recompiled  each  user  called  it 
a  number  of  times  submitting  as  control  input  the  number  of  times  the 
program  should  execute  its  major  loop.  The  code  multiplied  two  thirty 
by  thirty  matrices,  and  stored  the  result  in  a  third  matrix.  Each  user 
task  measured  and  printed  its  response  time,  and  stored  the  information 
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on  a  file  for  later  statistical  analysis.  The  second  program,  TEST  2, 
was  a  small  job  which  adds  the  integer  one  to  a  counter  a  specified  number 
of  times  and  then  stops.  The  third  program,  TEST3 ,  was  similar  to  TESTl 
in  computing  requirements,  but  it  demanded  a  large  amount  cf  storage 
(approximately  23,000  words).  All  of  the  programs  computed  the  elapsed 
time  required  by  the  system  to  process  each  request.  The  users  saved  all 
terminal  listings  for  later  data  verification  purposes. 

Figure  4.2  is  a  graph  of  the  sample  averages  of  response  times  for 
the  three  tests.  The  horizontal  axis  measures  the  computing  request  in 
terms  of  the  number  of  iterations,  I,  through  the  major  loop  of  TESTl. 

Each  of  the  other  programs  was  scaled  to  this  measure  of  central  processor 
demand.  Each  point  on  the  graph  represents  the  sample  average  of  requests 
having  the  same  value  of  I. 

4.2.2  TSS/360  Probe  Experiment 

The  goal  of  this  experiment  is  to  investigate  mean  response  as  a 
function  of  system  load  and  service  request  in  a  typical  user  environment. 
Over  a  period  of  a  number  of  weeks  a  version  of  TESTl,  which  is  listed 
in  Figure  4.3,  was  submitted  to  TSS/360  as  a  conversational  task.  A  sup¬ 
porting  package  was  written  to  simplify  the  execution  of  each  run  of  the 
probe.  One  command  initiated  a  complete  cycle  of  five  replications  of 
TESTl,  each  with  a  different  parameter  to  control  the  processing  request. 

As  in  the  previous  experiment,  control  information  was  in  terms  of  the 
number  of  required  iterations  of  the  major  loop  of  the  program.  Data 
points  were  saved  in  a  master  file  for  later  processing.  Each  data  block 
included  the  time  of  the  experiment,  the  number  of  active  conversational 


Figure  4.2 

Average  Response  Time  as  a  Function  of  Service  Request  -  TSS/360 
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Figure  4.  3 
Listing  of  TEST1 


0000100  DIMENSION  IB(8),IE(8) 

0000200  DIMENSION  Ml ( 30, 30  ), M2 ( 30,  30 ) , M3 ( 3 0,  3 0 ) 

0000300  100  PRINT  899 

0000400  899  FORMAT ( / 1  TEST1 :  PLEASE  ENTER  N  IN  FORMAT  12') 

0000500  READ  900, N 
0000525  900  FORMAT ( 12) 

0000550  IF  (N.EQ.O)  GO  TO  10 
0000600  PRINT  901, N 

0000700  901  FORMATC  TEST1 :  I  TERATI  ON- M  3  ) 

0000800  CALL  CLOCK( IB) 

0000900  DO  6  L-1,N 
0000910  DO  2  1-1,30 
0000920  DO  1  J-1,30 
0000930  Ml ( I , J  )-2 
0000940  M2 ( I ,  J)  =  3 
0000950  1  CONTINUE 
0000960  2  CONTINUE 
0000970  DO  5  1-1,30 
0000980  DO  4  J-1,30 
0000990  M-0 
0001000  DO  3  K-1,30 
0001010  3  M-M+M2 (l,K)*Mi(K,J) 

0001020  M3 ( I , J  )=M 
0001030  4  CONTINUE 
0001040  5  CONTINUE 
0001050  6  CONTINUE 
0001100  CALL  CLOCK(IE) 

0001200  TRAN-36000*( I E ( 1 )- I B ( 1 ) )  +  36Q0*( I E ( 2 ) -  I B (  2  )  )  +  600*( I E ( 3 ) -  I B ( 3 ) ) 
0001300  TRAN-TRAN+60*( IE(4)-IB(4))+10*(IE(5)-IB(5))+(IE(6)-IB(6)) 
0001400  TRAN-TRAN+ . 1*( I  E (  7  )- 1  B(  7  )  )  + .  01  *(  I  E  (  8  ) -  I  B (  8 )  ) 

0001700  PRINT  903,  IB 

0001701  903  FORMATC  START  TIME-  '  ,  2  I  1,  '  :  '  ,  2 1 1,  '  :  '  ,  2 1 1,  ' .  ' ,  2  1 1 ) 
0001702  PRINT  904, IE 

0001703  904  FORMATC  END  TIME-  ' ,  2 1 1,  ' : ' ,  2 1 1,  ' : ' ,  2 1 1,  ' . ' ,  2  1 1 ) 
0001704  PRINT  905, TRAN 

0001800  905  FORMATC  RESPONSE  TIME-  *  ,  F8 .  2  ) 

0001900  WRITE(1,800)  N, IB, IE, TRAN 
0001950800  FORMAT ( 2H  1, I  8, 8 1 1, 8  1 1, F8 . 2  ) 

0002000  GO  TO  100 
0002050  10  PRINT  906 

0002051  906  FORMATC  TEST1  NOW  COMPLETE.  YOU  ARE  IN  COMMAND  MODE') 
0002052  STOP 
0002100  END 


TEST1:  PLEASE  ENTER  N  IN  FORMAT  12 
01 

TEST1:  ITERATION  1 
START  TIME=  20:17:05.86 
END  TIME=  20:17:13.36 
RESPONSE  TIME=  3.00 


TEST1:  PLEASE  ENTER  N  IN  FORMAT  12 
01 

TEST1:  I TERATI ON=  1 
START  TIME=  20:14:24.35 
END  Tlf1E=  20:15:19.09 
RESPONSE  TIME=  54.74 


-102- 


users,  control  information  and  the  response  time  experienced  by  the  pro¬ 
gram.  The  system  operator  initiated  a  run  of  the  probe  approximately 
once  e-ery  hour  while  TSS  was  running  user  jobs. 

The  probe  ran  in  a  different  environment  each  time  it  was  initiated. 
The  program  remained  the  same,  but  the  system  load  varied  from  light  to 
heavy.  Detailed  status  information  about  each  user  was  not  gathered.  The 
data  were  classified  according  to  the  number  of  active  users  and  the  pro¬ 
cessing  request.  Figure  4.4  is  a  graph  of  the  sample  average  of  response 
time  conditioned  on  service  request  for  a  number  of  different  system  loads. 
Each  line  represents  a  different  user  population  density.  Data  points 
were  aggregated  into  four  classes  according  to  the  number  of  active  users 
on  the  system  (5-10,  10-15,  15-20,  20-25).  Figure  4.5  treats  the  same 
data  in  a  different  way.  Instead  of  displaying  equal  load  lines,  this 
graph  presents  equal  service  request  curves  plotted  against  the  number  of 
active  users.  Since  the  users  were  grouped  into  classes,  the  data  points 
are  in  the  middle  of  the  appropriate  intervals.  Again  the  service  request 
is  measured  in  terms  of  I,  the  number  of  times  the  probe  had  to  execute 

its  major  loop. 

4.3  EXPERIMENT  ON  EXEC -8 

EXEC-8  is  a  general  purpose  time  sharing  operating  system  which  runs 
on  the  Univac  1108  computer.  Many  of  its  design  goals  are  the  same  as 
TSS/360.  One  major  difference  in  philosophy  is  that  there  is  no  virtual 
memory.  Instead  of  dividing  programs  into  pages,  as  in  TSS/360,  EXEC-8 
moves  entire  programs  back  and  forth  from  core  memory  to  external  storage. 

This  experiment  was  the  same  as  that  described  in  Section  4.2.1.  The 
overall  design  was  identical  to  Figure  4.1.  The  computer  had  196K  words 
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of  high  speed  core  storage,  and  a  fully  balanced  set  of  drums  and  disks. 
The  computing  system  was  dedicated  to  the  experiment  for  approximately  two 
hours.  The  test  was  part  of  an  overall  evaluation  of  EXEC-8  performed 
by  the  CMU  University  Computing  Council,  in  the  spring  of  1970,  and 
Univac  donated  the  time  at  their  Chicago  Information  Systems  Division  ser¬ 
vice  bureau.  Forth-three  users  participated  in  the  experiment.  Each 
followed  the  same  script,  and  each  saved  the  terminal  listings  for  later 
analysis.  Figure  4.6  is  the  graph  of  the  sample  averages  of  response 
conditioned  on  service  request.  Once  again  the  global  behavior  corres¬ 
ponds  to  the  predictions  of  the  analytic  models. 

4.4  DISCUSSION 

TSS/360  and  EXEC-8  are  large  operating  systems  which  control  complex 
time-sharing  systems.  The  philosophy  of  memory  organization  is  complete¬ 
ly  different  in  the  two  designs.  The  results  presented  in  this  chapter 
should  not  be  used  as  a  basis  for  comparing  the  two  different  systems. 

There  was  no  attempt  made  to  calculate  the  costs  of  the  machines,  and  thus 
one  cannot  make  cost  /performance  comparisons.  The  particular  programs 
used  in  the  script  and  for  the  probe  could  be  unintentionally  biased  to¬ 
wards  one  machine.  The  goal  of  this  chapter  was  not  to  compare  two  dif¬ 
ferent  systems,  but  to  observe  their  macroscopic  performance. 

The  models  of  Chapter  2  capture  enougl  of  the  basic  design  philosophy 
of  these  two  systems  to  predict  the  observations  that  for  equal  values 
of  load,  measured  in  terms  of  the  number  of  active  users,  response  is  a 
linear  function  of  service  request  and  that  for  equal  service  requests, 
response  is  a  non-linear  function  of  system  load.  One  important  variable 
not  explicitly  considered  in  any  of  the  previous  models  is  the  size  of 
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user  tasks.  Figures  4.2  and  4.6  show  that  for  equal  service  request, 
measured  in  instructions  from  the  central  processor,  response  depends 
on  the  size  of  the  program.  TESTl  required  approximately  3,000  words 
for  its  code  and  data,  and  TEST2  needed  only  a  few  hundred  words. 

TEST3,  however,  was  relatively  large  and  required  approximately  23,000 
words  of  core  storage.  New  models  which  consider  the  memory  require¬ 
ments  of  user  programs  should  be  developed  to  investigate  this  observed 
relationship  between  response  and  size. 

Analytic  models,  simulations,  and  empirical  investigations  should 
interact.  Section  1.1  outlined  a  number  of  ways  these  tools  should  aid 
each  other  in  systems  analysis.  The  results  of  this  chapter  clearly  in¬ 
dicate  that  future  analytic  models  should  consider  memory  requirements 
as  an  explicit  parameter.  The  results  also  show  that  models  like  those 
of  Chapter  2  do  have  the  ability  to  predict  macroscopic  behavior  of  actual 
systems.  The  next  chapter  illustrates  a  number  of  ways  these  analytic 
results  may  be  used. 
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CHAPTER  5 

APPLICATION  OF  THE  MODELS 


5.1  INTRODUCTION 

Chapter  2  contains  a  number  of  new  results  from  models  of  time-shared 
computing  systems.  Each  model  focussed  upon  a  different  feature  of  real 
systems  because  the  current  state  of  queueing  theory  makes  the  simultaneous 
treatment  of  all  such  features  very  difficult.  The  goal  of  this  chapter  is 
to  illustrate  how  models  of  this  level  of  complexity  may  be  used  in  three 
areas:  (1)  design  (2)  performance  improvement  studies  and  (3)  dynamic  system 

control.  The  user  of  such  models  need  not  have  the  mathematical  background 
to  develop  new  solutions,  but  he  must  understand  the  underlying  concepts  and 
assumptions.  The  developer  c.f  new  models  should  present  them  in  such  a  way 
as  to  make  these  features  readily  understandable  to  the  user.  The  presentation 
of  Chapter  2  was  an  attempt  to  make  the  assumptions  and  the  methodology  obvious. 
The  experiments  of  Chapters  3  and  4  are  included  to  demonstrate  that  systems 
of  greater  complexity  than  the  models,  including  real  time-shared  computers, 
behave  in  ways  which  the  models  predict.  This  chapter  presents  some  realistic 
examples  of  how  these  models  may  be  used. 

5.2  SOFTWARE  LOCKOUT  IN  A  MULTI-PROCESSOR 

The  following  problem  illustrates  the  use  modifications  of  the  develop¬ 
ments  of  Section  2.4  and  Section  2.5  in  a  real  design  problem.  The  Department 
of  Computer  Science  at  Carnegie-Mellon  University  is  implementing  both  a  multi¬ 
processor  system  called  C.mmp  (Bell  et  al.,  1971)  and  an  operating  system  for 
it  called  HYDRA  (Wulf  et  al,  1971).  The  major  goal  of  this  project  is  to 
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create  a  powerful  and  flexible  computing  system  which  will  support  parallel 
and  pipeline  processing  and  which  is  capable  of  orderly  growth  through  the 
addition  of  processors  and  memory.  A  major  problem  in  the  architecture  of 
such  a  system  is  the  scheduling  and  coordination  of  the  many  individual  pro¬ 
cessors.  The  approach  taken  in  HYDRA  is  to  have  a  common  shared  data  base 
which  contains  all  of  the  information  necessary  for  a  processor  to  make  a 
scheduling  decision.  While  one  processor  is  examining  or  updating  this  shared 
information  all  others  must  be  prohibited  from  accessing  or  changing  it.  The 
act  of  protecting  data  from  all  but  one  processor  is  called  locking  and  the 
code  accessing  this  data  is  called  a  critical  section. 

Figure  5.1  is  a  diagram  of  the  model  used  to  study  the  locking  of  critical 
sections  in  C.mmp.  Each  of  N  homogeneous  processors  is  a  source  of  scheduling 
requests,  and  each  request  must  gain  access  to  all  of  the  data  starting  with 
the  first  critical  section  and  proceeding  to  all  sections  in  order.  If  the 
first  critical  section  is  free,  the  processor  issuing  the  request  locks  the 
section  and  uses  (possibly  modifying)  the  data.  When  the  request  is  satis¬ 
fied,  the  processor  unlocks  the  first  critical  section  and  tries  to  gain  ac¬ 
cess  to  the  second.  If  a  critical  section  is  locked,  the  processor  must  wait 
for  access  until  it  has  been  unlocked  by  some  other  processor.  Thus,  a  queue 
of  waiting  processors  may  form  in  front  of  each  critical  section.  A  pro¬ 
cessor  will  be  designated  as  "blocked"  for  a  scheduling  operation  if  it  is 
either  waiting  for,  or  inside,  one  of  the  S  critical  sections. 

A  basic  design  problem  is  to  determine  how  many  critical  sections,  S, 
to  build  into  the  shared  data  base.  At  one  extreme  S  could  equal  the  number 
of  logically  distinct  information  segments  in  the  data  base,  and  at  the  other 
extreme  it  could  be  equal  to  unity  by  having  a  single  critical  section  include 
the  entire  data  base.  There  is  an  overhead  loss  of  L  tim'j  units  associated 
with  each  locking  and  unlocking  operation  which  would  be  minimized  by  setting 


FIGURE  5.1 

Critical  Section  Locking  in  C.ramp 
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S  equal  to  one,  but  this  solution  does  not  allow  for  concurrent  use  of  the 
scheduling  information.  Overall  system  efficiency  may  be  increased  signif¬ 
icantly  by  allowing  many  processors  to  have  simultaneous  access  to  the 
scheduling  information  even  though  the  additional  locking  operations  introduce 
more  overhead. 

Tlie  total  time,  T,  that  a  processor  must  have  access  to  the  shared  infor¬ 
mation  in  order  to  make  a  scheduling  decision  is  a  random  variable  due  to  the 
dynamic  nature  of  the  data  base  and  to  the  many  different  kinds  of  decisions. 
Let  the  time  spent  in  each  of  the  S  critical  sections  be  an  exponentially 
distributed  random  variable  with  mean  L  +  T/S.  This  approximation  includes 
an  assumption  that  the  designer  would  try  to  balance  the  system  so  that  pro¬ 
cessors  would  spend  the  same  mean  time  in  each  critical  section. 

5.2.1  A  Poisson  Source  Tandem  Queueing  Model  -  MODI 

A  simple  but  useful  model  to  explore  this  problem  is  the  Poisson  source, 
tandem  queueing  structure  discussed  in  Section  2.4.  Since  there  is  no  cycling 
of  requests  within  the  critical  sections,  the  appropriate  modification  of 
this  model  is  to  set  l,  the  probability  that  a  request  will  leave  the  system 
after  passing  through  the  S  servers,  to  unity.  All  arguments  presented  in 
Section  2.4  to  justify  analysis  based  on  independent  M/fa/1  queueing  systems 
apply  to  this  model  also. 

Let  the  source  of  scheduling  requests  be  Poisson  with  rate  X*N  requests 
per  unit  time  where  N  is  the  number  of  processors  making  requests,  and  X  is  the 
rate  from  an  individual  processor.  A  major  assumption  in  this  formulation 
which  is  not  realistic  is  that  a  processor  will  continue  to  issue  scheduling 
requests  before  the  previous  ones  have  been  satisfied.  Congestion  will  be 
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more  severe  in  this  model  than  in  a  more  realistic  formulation  which  assumes 
that  a  processor  may  not  generate  additional  scheduling  requests  when  it  is 
in  the  blocked  state.  The  next  section  considers  such  a  finite  source  model. 

The  mean  number  of  requests,  E(M^)  ,  either  waiting  for,  or  inside  of,  each 
of  the  S  critical  sections  is  simply  the  expected  number  of  tasks  in  an  M/h/1 
queueing  system  with  input  rate  X*N,  and  service  rate  1  /(L  +  T/S) . 

(5.1)  ECM^  =  X-N/{1/(L  +  T/S)  -  X-N} 

The  total  number  of  requests  waiting  for,  or  inside  of,  all  critical  sections 
is  E(Mj) .  Little  s  theorem,  presented  in  equation  (2.12),  relates  the  mean 
response  time  through  all  critical  sections,  E(R) ,  to  the  mean  number  of  blocked 
requests. 

(5.2)  E(R)  =  S.E  (Mj)  /(X-N)  =  S/{1 /(L  +  T/S)  -  X - N} 

Figure  5.2  is  a  graph  of  mean  response  through  all  critical  sections  for  different 
values  of  S  and  N  for  fixed  X,  L,  and  T  for  the  Poisson  source  model. 

5.2.2  Finite  Source  Models  -  M0D2 

A  more  realistic  approximation  to  actual  processor  behavior  than  the 
previous  model  is  the  assumption  that  each  of  the  N  processors  computes  for 
an  exponentially  distributed  random  interval  and  then  makes  a  scheduling 
request.  The  processor  will  be  unable  to  proceed  with  normal  computing  until 
it  has  gained  access  to  all  S  critical  sections  and  is  no  longer  in  the  blocked 
state.  As  in  the  previous  model,  the  time  spent  in  each  critical  section  will 
be  an  exponentially  distributed  random  variable  with  mean  L  +  T/S. 

If  the  number  of  critical  sections  equals  one,  the  model  reduces  to  one 
form  of  the  machine  repair  problem  discussed  in  Section  2.5 (with  the  overhead 
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loss  fraction,  f,  equal  to  zero).  Hadnlck  (1968)  used  this  model  to  calculate 
the  mean  number  of  blocked  processors,  when  S  1,  as  a  function  of  P,  the 
number  of  processors  in  the  system.  Jackson  (1963)  derives  results  for 
general  networks  of  Poisson  queues  which  have  stat<r'  dependent  inputs.  This 
general  solution  may  be  applied  to  this  model  in  a  straightforward  manner  to 
determine  the  mean  number  of  blocked  processors  for  an  arbitrary  number  of 
critical  sections,  S.  His  method  leads  to  the  following  equation  for  the  mean 
number  of  blocked  processors  in  the  finite  source  model  illustrated  in  Figure 
5.1. 


N 

E 

(5.3)  E(M)  = 

£ 

i=0 

Where  u  =  1  /( L  +  T/S) 


The  second  argument  used  to  derive  (2.69)  applies  to  this  model  and  thus 
equation  (2.70)  may  be  used  to  relate  mean  response  time  through  the  critical 
sections  to  mean  number  of  blocked  processors. 
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Figure  5.3  illustrates  the  relationship  between  the  mean  response  time  and 
the  number  of  processors,  N,  and  the  number  of  critical  sections  S,  for  fixed 
X,  L,  and  T  for  the  finite  source  model. 


A  lower  bound  for  mean  response  time  of  scheduling  requests  may  be 
obtained  using  an  idealized  state  dependent  service  rate  model  based  on 
the  development  of  Section  2.5.  In  this  model,  the  system  is  capable 
of  dynamically  reconfiguring  the  structure  of  the  shared  data  base  in  the 
following  way.  Let  m  be  the  number  of  processors  requiring  access  to  the 
scheduling  information  at  time  t.  The  ideal  system  would  provide  m  critical 
sections  at  time  t.  Whenever  a  processor  completes  its  scheduling  activity, 
or  whenever  a  processor  arrives  with  a  new  request,  the  accessing  program 
will  instantaneously  change  the  structure  of  the  data  base  to  provide 
exactly  the  same  number  of  critical  sections  as  processors  which  need  ac¬ 
cess  to  this  data.  In  addition,  all  m  processors  will  always  have  access 
to  some  data  so  that  they  will  never  be  idle  while  attempting  to  use  the 
shared  scheduling  information.  Although  this  scheme  is  obviously  imprac¬ 
tical,  it  does  lead  to  a  lower  bound  for  response  time,  and  one  may  see 
how  close  to  this  bound  a  practic  1  implementation  may  get. 

Since  every  processor  may  use  scheduling  information  at  once,  the 
exponential  service  rate  for  each  processor  is  l/(T+m-L),  where  m  is  the 
constantly  changing  number  of  processors  demanding  access  to  the  common 
data.  A  processor  will  not  have  to  wait  for  any  other  processor,  but  it 
will  pay  a  dynamic  overhead  penalty  with  rate  m-L  time  units  where  m  changes 
with  the  system  state.  Let  Pm(t)  be  the  probability  that  there  are  m  pro¬ 
cessors  in  critical  sections  at  time  t.  As  in  Section  2.5  one  may  write 
the  following  system  of  state  equations. 


(5.A)  PQ(t+6)  =  (1-N*X* 6)  •  PQ(t)  +  (l-(N-l) *X6)  •  6-P1(t)/(T+L)  +  o(62) 


p  (t)  =  (N-(m-l) )  •  X*  6  [l-(m-l)  •  6/(T+(m-l)  *L)  }  •  P  ^(O 
m 

+  (l-(N-m) *X* 6)  •  {1-tn*  6/ (T+m*L) }  •  1^(0 

+  {(m+1)  •  §/ (T+(m+l) *L)  }  •  (l-(N-(m+l) -X- 6}  •  Pjn+1(t)  +  0(6  >» 

m=l ,2 , . . . ,N-1 

PN(t)  =  X-6-[l-(N-l)*6/(T+(N-l)-L)}*PN_1(t) 

2 

+  [1-N*  6/(T+N*L) }  PN(t)  +  °(&  > 

Following  exactly  the  same  procedure  as  in  Section  2.5,  one  first  collects 

terms  and  then  takes  the  limit  as  6  -  0  to  get  P^t).  In  statistical 

equilibrium  lim  P' (t)  =  0,  and  lim  P  (t)  =  Pm-  The  result  of  this  manipula¬ 
te®  m  t-*“ 

tion  is  the  following  set  of  steady  state  equations. 

m 

(5.5)  Pm  =  Pq  *n  X*  (N-(i-l) )  •  (T+i*L)/i ,  m=l,/_ . N 

N 

Pn  -  1  -  Z  Pm 

0  m 

1=1 

One  may  calculate  the  mean  number  of  processors  in  the  blocked  state  by 
solving  the  above  set  of  equations  and  then  using  equation  (2.63).  liqua¬ 
tion  (2.70)  relates  the  mean  response  time  for  a  scheduling  request  to  the 
mean  number  of  blocked  processors.  On  Figure  5.3,  the  line  labeled 
"S  =  ideal"  is  the  plot  of  mean  response  time  for  this  idealized  version 
of  the  critical  section  scheduling  problem. 


5.2.3  Discussion  of  Results 

Both  Figure  5.2  and  Figure  5.3  illustrate  the  same  types  of  performance 
changes  with  respect  to  changes  in  the  number  of  processors  and  the  number 
of  critical  sections.  Mean  response  time  increases  with  the  number  of 
processors.  For  a  constant  number  of  critical  sections,  S,  the  increase 
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in  mean  response  Ume  is  approximately  linear,  with  respect  to  N,  until 
the  system  becomes  congested.  As  N  increases  beyond  this  point,  the  slope 
of  mean  response  time  as  a  function  of  N  grows  larger  with  increasing  N. 
This  non-linear  response  time  degradation  as  a  function  of  the  number  of 
processors  is  more  severe  in  the  first  model  (because  processors  continue 

to  submit  requests  while  blocked)  than  in  the  second,  but  it  is  evident  in 
bo  th. 

The  addition  of  one  more  critical  section  significantly  improves  mean 
response,  for  higher  values  of  N,  in  both  models.  The  additional  locking 
overhead,  L,  associated  with  each  critical  section  degrades  performance 
slightly  for  small  values  of  N.  At  these  low  values  of  N,  the  arrival  rate 
of  requests  is  so  low  that  the  extra  locking  overhead  is  not  compensated 
for  by  the  potential  parallel  utilization  of  the  S  critical  sections. 

An  interesting  characteristic  of  these  models  is  the  large  performance 
improvement  achieved  by  the  creation  of  one  or  two  additional  critical 
sections.  Figure  5.3  demonstrates  that  when  S=2,  the  response  time  im¬ 
provement  is  about  one  half  of  what  the  idealized  system  could  provide. 

The  improvement  is  greater  for  higher  arrival  rates  of  scheduling  requests. 
The  slight  response  time  degradation  for  low  arrival  rates  indicates  that 
an  efficient  design  would  be  the  implementation  of  a  few  (S=2,  or  3) 
critical  sections.  This  choice  would  create  an  effective  safety  valve. 
Whenever  the  load  would  increase,  parallel  access  to  the  data  would  occur 
and  the  shared  scheduling  information  would  not  become  a  bottleneck.  The 
overhead  penalty  at  low  arrival  rates  is  in  the  neighborhood  of  only  five 

percent  and  the  improvement  at  higher  request  rates  is  approximately  fifty 
percent. 
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All  conclusions  drawn  from  a  model  like  this  depend  on  the  values 
of  the  input  parameters.  The  variables  isolated  for  this  model  are: 

X,  the  mean  arrival  rate  of  scheduling  requests  from  each  processor;  N, 
the  number  of  processors;  S,  the  number  of  critical  sections;  T,  the  mean 
time  required  to  perform  a  scheduling  operation;  and  L,  the  mean  time 
needed  to  lock  and  unlock  a  critical  section.  The  system  designers  can 
determine  the  values  of  T  and  L  from  code  requirements  and  the  speed  of 
the  processors,  and  they  know  the  range  over  which  N  may  vary.  However, 
one  needs  an  estimate  of  X  to  determine  the  best  value  of  S.  Unfortunately, 
this  parameter  is  very  hard  to  estimate  before  the  system  has  been  built. 

This  basic  dilemma  is  at  the  heart  of  many  crucial  design  decisions. 

One  needs  the  value  of  an  important  parameter  to  make  a  good  implementation 
decision,  but  that  value  can  only  be  estimated  with  a  reasonable  degree 
of  confidence  after  the  system  has  been  in  operation  for  some  time.  A 
good  analytic  model  can  be  an  important  tool  in  such  decisions.  The  nature 
of  system  response  over  a  wide  range  of  possible  values  may  be  easily 
studied.  These  sensitivity  studies  may  lead  directly  to  a  solution,  or 
they  may  help  to  plan  a  strategy  for  future  experimentation  and  performance 
evaluations. 

For  example,  the  model  of  scheduling  activity  in  C.mmp  indicates  that 
when  the  number  of  processors  is  less  than  four  or  five,  and  scheduling 
requests  arrive  with  a  mean  interarrival  time  of  five  milliseconds  (X-l/5000) 
from  each  processor,  a  single  critical  section  is  all  that  is  needed.  As 
one  adds  more  processors,  or  alternatively,  if  the  rate  of  scheduling  re¬ 
quests  is  much  greater  than  this  estimate,  then  one  or  two  additional 
critical  sections  will  improve  performance  significantly.  Since  both  the 
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overhead  penalties  at  low  request  rates,  and  the  implementation  costs,  are 
small  for  these  additional  critical  sections,  the  designers  at  Carnegie- 
Mollon  chose  a  multiple  locking  strategy  for  C.mmp. 

5.3  PERFORMANCE  IMPROVEMENT  ANALYSIS 

Consider  a  time  sharing  system  similar  to  the  IBM  360/67.  This  sys¬ 
tem,  using  the  operating  system  TSS/360,  was  the  basis  for  the  simulation 
presented  in  Section  3.5  and  it  was  used  for  the  empirical  investigations 
reported  in  Section  4.2.  Many  of  the  powerful  features  of  this  system 
lead  to  high  overhead  costs.  The  virtual  memory  design  gives  every  user 
a  working  space  for  programs  and  data  that  is  much  larger  than  the  amount 
of  high  speed  core  memory  in  the  system.  The  operating  system  manages 
this  virtual  memory  so  that  users  do  not  have  to  worry  about  storage  al¬ 
location  problems.  When  a  user  wants  some  information  that  is  not  cur¬ 
rently  stored  in  the  high  speed  memory  the  system  will  automatically 
retrieve  it  from  secondary  storage.  All  information  in  the  system  is 
divided  into  blocks  called  pages.  A  page  fault  occurs  when  a  program 
needs  access  to  a  page  that  is  not  currently  in  high  speed  memory. 

Each  page  fault  causes  both  an  overhead  operation, due  to  the  many 
bookeeping  functions  that  must  be  performed,  and  a  request  to  the  input/ 
output  (l/o)  subsystem  to  retrieve  the  new  page.  Quite  often  a  page 
already  in  memory  must  be  placed  in  external  storage  to  make  room  for 
the  new  page.  The  page  fault  rate  is  related  to  the  amount  of  high  speed 
core  allocated  to  each  active  user.  As  each  user's  core  allocation  be¬ 
comes  smaller  he  will  generate  more  page  faults.  Computers  with  a  virtual 
often  have  been  observed  to  enter  a  mode  of  operation,  commonly 
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called  thrashing, in  which  each  user  is  allocated  so  little  core  memory 
that  he  generates  a  page  fault  very  soon  after  gaining  control  of  the 
central  processor.  Then  the  combined  page  request  rate  from  all  users 
may  exceed  the  capacity  of  the  i/o  subsystem.  When  thrashing  begins 
efficiency  drops  very  quickly  due  to  the  cjmbined  effects  of  page  fault 
overhead  and  the  i/o  system  bottleneck.1  A  common  cause  of  thrashing  is 
allowing  too  many  active  programs  to  be  squeezed  into  core  memory  with 
the  result  that  none  has  enough  of  this  resource. 

A  manager  of  this  type  of  time-shared  system  can  improve  system 
performance  in  a  number  of  ways.  This  section  will  illustrate  how 
the  models  of  Chapter  2  may  aid  in  a  study  of  alternative  performance 
improvement  plans.  For  example,  changes  in  technology,  or  in  operating 
budgets,  may  make  it  feasible  either  to  increase  the  processing  capacity 
of  the  central  processor  (C, measured  in  instructions  executed  per  unit 
time)  or  to  increase  the  total  amount  of  core  memory  available.  One  may 
want  to  combine  both  methods.  The  performance  measure  used  here  will  be 
the  mean  response  time  experienced  by  the  users.  The  hypothetical  system 
will  have  characteristics  that  are  useful  for  illustrative  purposes,  and 
will  not  be  representative  of  any  particular  implementation. 

Increasing  C,  the  instruction  rate  of  the  computer,  will  benefit 
users  because  their  tasks  will  take  less  processing  time.  A  common  way 
of  increasing  C  is  to  improve  the  performance  of  the  memory  in  the  system. 

For  example,  the  360/67  at  Carnegie -Mel Ion  was  configured  with  a  large 
amount  of  core  memory,  called  LCS  (Large  Capacity  Store),  having  a  relatively 
slow  cycle  time.  Improvements  in  memory  technology  made  it  possible  to 
1 

See  Denning  (1968)  or  (1970)  for  good  discussion  of  thrashing. 
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lncrease  the  speed  of  similar  memories  by  a  factor  of  approximately 
three.  If  the  number  of  active  users  is  kept  below  the  number  that  causes 
thrashing,  what  improvement  may  be  expected  in  mean  response  time  if  c 
is  increased  by  a  factor  of  two  0r  three  and  all  other  parameters  remain 
constant?  An  increase  in  C  would  be  of  little  help  if  the  system  were 
operating  under  conditions  where  thrashing  could  occur  frequently. 

Increasing  the  amount  of  core  memory  available  will  help  users  be¬ 
cause  they  will  be  able  to  compute  for  longer  intervals,  when  they  have 
control  of  the  central  processor,  before  causing  a  page  fault.  Overhead 
will  decrease  because  there  will  be  fewer  page  faults  to  process,  and  the 
paging  demand  placed  on  the  i/o  system  will  also  decrease.  How  much  will 
a  two  or  three  fold  decrease  in  the  number  of  page  faults  experienced  by 
a  task  benefit  mean  response  time  if  all  other  parameters  remain  the  same? 
What  effect  would  one  observe  from  a  combination  of  these  two  possible 
performance  improvements? 

The  hypothetical  system  which  will  form  the  basis  for  the  analysis 
will  be  a  computer  with  the  following  basic  characteristics;2 

(a)  the  original  speed  of  i:be  central  processor  will  Le 
250,000  instructions  per  second; 

(b)  tasks  arrive  at  the  system  with  a  mean  rate  of  2  per  second; 

(c)  each  task  originally  will  issue  an  average  of  40  page 
faults  per  request; 


(d)  each  request  will  be  for  an  exponentially  distributed 


number  of  instructions  having  a  mean  value  of  vl  =  50,000; 


current- ^ ?  characteristics  are  illustrative  representations  of  some 
current  time-shared  computers  which  make  use  of  extended  core  storage 
devices  and  a  virtual  memory  design.  storage 


-123- 


(e)  the  overhead  time  to  process  a  page  fault  will  be  a 
random  variable  with  a  mean  of  5  milliseconds;  (Since 
a  page  fault  will  occur  with  a  mean  rate  of  once  every 
50,000/40  =  1,250  instructions,  or  about  once  every  5 
milliseconds,  the  system  is  spending  approximately  50 
percent  of  its  time  in  paging  overhead  operations.) 

(f)  the  time  required  to  locate  and  transfer  a  page  of  in¬ 
formation  from  external  storage  will  be  approximately 
10  milliseconds. 

In  the  following  analysis  three  different  types  of  possible  per¬ 
formance  improvements  will  be  considered: 

Case  (a)  Mean  overhead  time  required  to  process  a  page  fault  will 
remain  constant  at  dl  =  .005  seconds  per  page  fault  re¬ 
gardless  of  the  value  of  C,  the  effective  speed  of  the 
central  processor.  C  will  increase  from  250,000  to 
550,000  instructions  per  second. 

Case  (b)  The  mean  number  of  instructions  required  to  process  a  page 
fault  will  remain  constant  at  dl*I  =  1250  instructions. 

Thus  the  mean  time  needed  to  process  each  page  fault  will 
be  (dl-l/c).  C  will  increase  from  250,000  to  550,000  in¬ 
structions  per  second. 

Case  (c)  C  will  remain  constant  at  250,000  instructions  per  second, 
but  the  mean  number  of  page  faults  generated  by  each  task 
.  will  decrease  from  40  per  interaction  to  18.2  per  interaction 


(Z  increases  from  .025  to  .055). 


The  distribution  of  the  number  of  instructions  a  task 


requests  will  remain  the  same,  but  tasks  will  compute  for 
longer  periods  of  time  before  generating  a  page  fault. 

Increasing  the  effective  speed  of  the  central  processor  may,  or  may  not, 
have  an  effect  on  time  required  to  perform  overhead  operations  associated 
with  a  page  fault.  Case  (a)  represents  system  designs  in  which  an  in¬ 
crease  in  the  instruction  rate  of  core  memory  dedicated  to  users  does  not 
affect  the  speed  of  overhead  activities  associated  with  the  resour  a  al¬ 
location  functions  of  the  operating  system.  For  example*,  the  system  could 
have  a  memory  hierarchy  in  which  the  operating  system  used  the  fastest, 
and  most  expensive,  memory  in  the  system  and  user  programs  ran  in  slower 
core  memory  (LCS).  Performance  improvements  in  LCS  would  not  affect  the 
speed  of  overhead  functions  which  make  use  of  the  high  speed  memory. 

Case  (b)  represents  the  situation  in  which  the  performance  of  all  memory 
in  the  system  is  improved.  Case  (c)  illustrates  the  effects  of  an  addition 
of  ro  re  memory  to  the  system  with  a  resulting  decrease  in  paging  activity. 

5.3.1  TSMODl  Analysis 

Figure  2.1  illustrates  the  structure  of  TSMODl.  Paging  overhead  is 
treated  explicitly  in  this  model.  Overhead  will  be  a  random  variable 
having  a  mean  of  dl  and  standard  deviation  of  dl/5.  Equation  2.24  pre¬ 
sents  the  functional  relationship  between  mean  response  time  and  the  other 
system  parameters.  Let  the  expected  value  of  V  (the  number  of  instruc¬ 
tions  required  to  complete  a  task's  request)  be  vl,  and  the  expected  value 
of  W  (the  number  of  instructions  executed  between  page  faults)  be  wl.  If 
V  has  an  exponential  distribution,  W  will  also  have  an  exponential  distribution 
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with  mean  £*vl  and  second  moment  w2  =  2.(wl)2.  The  values  of  all  para¬ 
meters  needed  for  the  initial  configuration  of  the  model  are: 

C  =  250,000  instructions/second 

X  =  2  tasks/second 

£  -  1/40 

vl  =  50,000 

wl  =  £*vl 

w2  =  2  •  ( £.  vl)2 

dl  -f005>  case  <a) 

]1250/c,  case  (b) 
d2  =  (d 1/ 5 ) 2  +  (dl)2 

Note  that  the  i/o  system  does  not  appear  in  this  model.  An  implicit 
assumption  associated  with  this  structure  is  that  the  i/o  system  is  not  a 
bottleneck  and  will  not  significantly  affect  performance.  Any  delays 

associated  with  page  transfers  will  degrade  performance  from  that  predicted 
by  TSMODl. 

Figure  5.4  presents  graphs  of  the  performance  increases  which  result 
from  the  three  different  strategies  (a),  (b),  and  (c).  The  first  example 
of  Section  2.3.3  indicated  that  when  overhead  is  not  present  and  when  all 
other  parameters  were  held  constant,  changes  in  £  did  not  cause  changes 
in  the  mean  response  time.  As  more  quantizing  took  place  (£  decreased) 
the  standard  deviation  of  response  increased,  but  the  mean  remained  the 
same.  Figure  2.2  illustrated  the  effects  of  a  type  (c)  improvement  in 
an  overhead  free  environment.  However,  the  overhead  included  in  the  model 
this  section  has  a  large  effect  upon  mean  response  as  £  changes. 

the  paging  rate  in  half  is  equivalent  to  doubling  the  speed  of 
core  dedicated  to  users.  A  careful  examination  of  equation  (2.34)  indicates 
that  an  increase  in  C  produces  a  response  time  improvement  similar  to  a 


ins 
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decrease  in  the  number  of  instructions  required  to  satisfy  a  task's 
request.  A  decrease  in  the  paging  rate  (an  increase  in  Z)  produces  an 
improvement  similar  to  a  reduction  in  overhead  delay  associated  with  the 
processing  of  page  faults.  Cases  (a)  and  (c)  produce  almost  exactly  the 
same  improvements.  Case  (b)  reduces  the  load  on  the  central  processor 
by  decreasing  the  times  required  to  process  both  a  task's  request  and 
the  overhead  associated  with  each  page  fault. 

5.3.2  TSM0D2  Analysis 

Figure  2.6  illustrates  the  structure  of  TSM0D2 .  An  i/o  subsystem 
in  tandem  with  the  central  processor  allows  one  to  consider  the  effects 
of  page  transmission  delays  on  mean  response  time.  To  keep  the  analytic 
formulation  tractable,  one  must  assume  that  the  service  times  spent  in 
both  the  central  processor  and  the  i/o  system  are  exponentially  distributed. 
The  analysis  of  Section  2.4  did  not  include  any  provision  for  overhead 
degradation  due  to  the  processing  of  page  faults. 

One  may  introduce  overhead  into  TSM0D2  in  the  following  way.  Let 
the  service  time  spent  in  the  central  processor  be  an  exponentially  dis¬ 
tributed  random  variable  having  a  mean  of  (vl/c  +  .005/ 4)  seconds  for 
case  (a)  and  a  mean  of  (vl/c  +  1250/(C*4))  seconds  for  case  (b).  As  in 
the  previous  section  the  total  number  of  instructions  required  to  satisfy 
a  task  s  request  will  have  a  mean  value  of  vl.  The  mean  time  spent  in 
the  central  processor  during  each  quantum  interval  will  be  an  exponentially 
distributed  random  variable  with  mean  <(vl- A)/c  +  .005)  seconds  for  case 
(a)  and  mean  ((vl-£+  1250)/c)  seconds  for  case  (b).  This  formulation 
retains  the  essential  features  of  a  random  quantum  interval  which  is 
divided  into  an  overhead  segment  and 


a  processing  segment. 
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Equation  (2.55)  presents  the  mean  response  time  in  TSM0D2  conditioned 
on  the  fact  that  a  job  requires  v  instructions.  Since  this  is  a  linear 
function  of  v,one  may  remove  the  condition  by  replacing  v  with  its  ex¬ 
pected  value  presented  in  the  preceding  paragraph.  Let  the  time  re¬ 
quired  to  find,  and  then  transfer,  a  page  from  external  storage  be  an 
exponentially  distributed  random  variable  with  mean  wl2  =  .01  seconds. 

All  parameters  required  for  this  model  have  now  been  specified. 

Figure  5.5  is  a  graph  of  the  performance  increases  achieved  by  using 
the  three  improvement  plans.  In  this  model  an  increase  in  C,  the  pro¬ 
cessing  rate  of  the  central  computer,  has  no  effect  on  the  i/o  subsystem. 
Case  (b)  is  again  better  than  case  (a)  because  an  increase  in  C  reduces 
the  overhead  delay.  But  the  best  of  the  three  strategies  is  case  (c). 

A  reduction  in  the  paging  rate  achieved  by  the  addition  of  more  core 
reduces  both  overhead  and  the  demand  on  the  i/o  system.  For  case  (c) 
the  system  maintains  a  better  overall  balance,  and  neither  subsystem  be¬ 
comes  overly  congested. 

5.3.3  TSM0D3  Analysis 

TSM0D3  is  a  finite  source,  processor-shared,  model  with  an  overhead 
loss  which  is  a  function  of  the  state  of  the  system.  Figure  2.8  illustrates 
the  structure  of  this  configuration.  Like  TSMODl,  this  model  does  not 
have  an  i/o  subsystem  and  thus  an  implicit  assumption  in  its  use  is  that 
the  i/o  delay  is  not  significant.  Any  delay  in  the  i/o  system  will  add 
to  response  times  cixnputed  by  this  formulation. 

The  model  does  not  explicitly  consider  any  overhead  associated  with 
the  processing  of  page  faults.  The  state  dependent  overhead  loss  represents 
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general  overhead  degradation,  but  it  is  not  a  function  of  the  paging  rate. 
To  apply  the  model  to  the  situation  of  interest  in  this  section  one  may 
take  the  same  approach  as  in  Section  5.3.2.  The  instantaneous  exponential 
rate  for  each  job  in  the  processor-shared  system  was  called  v*C*(l-f*m) 
in  Section  2.5.  The  number  of  tasks  in  the  processor  at  each  instant  of 
time  is  m.  Let  v*C  be  equal  to  j&*c/(vl*£  +  .005*0  for  case  (a)  and 
j£*c/(vl*£  +  1250)  for  case  (b).  Since  the  mean  of  an  expenential  process 
with  rate  v*C  is  l/(v*C)  this  formulation  leads  to  the  same  expected  pro¬ 
cessing  times  as  the  previous  derivation.  This  model  also  retains  the 
essential  characteristic  of  a  random  quantum  interval  which  is  divided  into 
an  overhead  and  a  processing  segment.  The  state  dependent  loss  factor 
(1-f *m)  will  be  applied  as  it  was  in  Section  2.5. 

Let  N,  the  number  of  terminals  making  requests  upon  the  system,  be 
40  and  let  the  time  between  the  completion  of  one  request  and  the  sub¬ 
mission  of  the  next  be  an  exponentially  distributed  random  variable  with 
a  mean  of  20  seconds  (X  =  1/20).  Let  the  overhead  loss  fraction,  f,  be 
.02.  All  parameters  required  for  TSM0D3  have  now  been  specified  and  one 
may  examine  cases  (a),  (b),  and  (c).  Figure  5.6  is  a  graph  of  the  per¬ 
formance  increases  achieved  by  using  these  three  plans.  An  examination 
of  the  equations  of  Section  2.5  indicates  that  for  cases  (a)  and  (c)  an 
increase  in  the  processing  rate,  C,  is  equivalent  to  a  reduction  in  the 
paging  rate.  Thus  the  curves  for  cases  (a)  and  (c)  coincide.  Case  (b) 
achieves  a  better  level  of  performance  because  an  increase  in  C  has  a 
direct  effect  on  the  overhead  delay  associated  with  each  page  fault. 
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5.3.4  Discussion  of  Results 

Each  of  the  three  models  used  to  study  the  hypothetical  performance 
improvement  problem  concentrates  on  a  few  important  features  of  time- 
shared  computing  systems.  In  the  previous  sections  each  model  was  modified 
so  that  it  could  be  applied  to  a  problem  for  which  it  was  not  specifically 
designed.  For  example,  TSMODl  and  TSM0D3  do  not  include  subsystems 
which  can  represent  input/output  activities.  TSM0D3  is  the  only  formula¬ 
tion  which  considers  the  effects  of  both  a  finite  user  population  and  an 
overhead  degradation  which  is  a  function  of  system  state.  TSM0D2  and  TSM0D3 
both  require  that  service  requests  be  exponentially  distributed  random 
variables,  and  neither  of  these  two  models  includes  an  explicit  mechanism 
for  studying  the  effects  of  paging  overhead. 

By  carefully  redefining  some  important  parameters  one  may  apply  all 
of  these  models  to  the  peri-orraance  improvement  problem.  Each  model  allows 
the  analyst  to  focus  on  a  different  aspect  of  system  design.  The  results 
clearly  show  that  performance  may  be  significantly  improved  by  either  in¬ 
creasing  the  processing  rate  or  decreasing  the  paging  rate.  All  three 
graphs  also  indicate  that  the  performance  improvement  curves  level  out 
after  an  initial  interval  of  a  higher  rate  of  change. 

All  of  the  models  point  to  additional  studies  which  should  be  made. 

For  example,  none  includes  a  functional  relationship  between  the  size  of 
core  and  the  paging  rate.  All  of  the  models  predict  significant  performance 
improvements  if  one  can  lower  the  paging  rate,  but  the  amount  of  additional 
core  which  would  be  required  no  cut  the  paging  rate  in  half  (by  doubling 
£)  is  beyond  the  scope  of  these  analytic  models.  A  simulation  such  as 
the  one  presented  in  Section  3.5  can  help  with  this  problem.  In  addition. 
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a  carefully  designed  experiment  on  the  current  configuration  could  help 
quantify  this  relationship. 

The  following  list  illustrates  some  (of  the  many)  additional  consider¬ 
ations  which  would  be  required  prior  to  an  actual  performance  improvement 
decision:  the  relative  costs  of  more  versus  faster  memory;  comparative 

reliabilitites  of  different  memories;  maintenance  problems;  vendor 
comparability;  purchasing  and  leasing  agreements;  interface  problems  with 
other  system  components;  predictions  of  future  usage  patterns  and  tech¬ 
nological  improvements;  changeover  costs;  other  subsystem  improvements. 

The  use  of  analytic  models  as  a  performance  analysis  tool  can  help  reduce 
uncertainty  in  some  of  these  dimensions  and  thereby  improve  the  decision 
making  process. 

5.4  DYNAMIC  SYSTEM  CONTROL 

All  of  the  models  applied  to  the  performance  improvement  problem  of 
the  previous  section  show  that  response  time  will  increase  with  the  paging 
rate.  As  the  number  of  users  competing  for  core  in  a  virtual  memory  sys¬ 
tem  grows  the  paging  rate  increases.  At  the  end  of  a  quantum  interval 
systems  which  do  not  have  a  virtual  memory  structure  must  often  save,  in 
external  storage,  that  portion  of  a  user's  program  and  data  which  is  cur¬ 
rently  in  core  memory.  The  saving  of  one  core  image  in  external  storage 
and  the  retrieval  of  a  different  one  is  usually  called  swapping.  Swapping 
need  not  occur  at  the  end  of  every  quantum  because  core  may  be  large  enough 
to  hold  several  tasks  at  one  time.  As  the  load  increases,  and  more  users 
demand  service,  the  swapping  rate,  like  the  paging  rate  in  a  virtual 
memory  design,  will  increase.  The  overhead  associated  with  paging  and 
swapping  will  cause  response  time  degradation. 
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Figures  2.3,  2.6,  2,7,  and  2.9  show  that  as  the  arrival  rate  of 
requests  grows,  expected  response  time  increases  in  a  nonlinear  manner. 
This  degradation,  as  a  function  of  the  arrival  rate,  occurs  even  when 
there  is  no  overhead  associated  with  swapping  or  the  processing  of  page 
faults.  With  overhead  present  the  effects  are  magnified.  The  phenomenon 
of  thrashing,  which  was  described  in  the  previous  section,  is  an  extreme 
example  of  what  can  happen  when  overload ii.g  occurs. 

Quick  response  to  short  requests  is  a  major  goal  of  time-shared 
computing  systems.  To  maintain  a  reasonable  level  of  response  all  such 
systems  must  limit  the  input  rate  of  requests.  For  example,  at  Carnegie- 
Mellon  a  Logon  Priority  system  Limits  the  number  of  interactive  terminal 
users  to  a  pre-set  limit.  If  someone  tries  to  join  the  system  and  the 
number  of  people  currently  logged  on  is  equal  to  the  limit,  the  new  user 
is  denied  access  until  the  system  can  force  one  of  the  active  users  to 
leave.  The  algorithm  which  makes  the  decision, about  which  job  should  be 
forced,  considers  factors  such  as  pre-assigned  priorities  and  the  length 
of  time  each  of  the  current  users  has  been  connected  to  the  system.  The 
algorithm  chooses  a  user  to  be  forced  from  the  system  and  then  notifies 
him  that  he  must  Leave  within  the  next  tvo  minutes  or  be  automatically 
terminated.  If  the  algorithm  is  unable  to  find  a  user  who  meets  all 
criteria  for  automatic  termination,  the  new  user  is  denied  access.  Once 
a  user  has  been  allowed  to  logon  to  the  system  he  is  guaranteed  a  minimum 
length  of  time  during  which  he  may  use  the  computer. 

McCredie  (1967),  Wulf  (1969),  Wilkes  (1971),  Mills  (1971),  and  others 
have  suggested  that  dynamic  load  adjustment  procedures  be  used  to  control 
the  performance  of  computing  systems.  CTSS,  a  time-shared  system  developed 
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at  MIT,  has  such  an  automatic  load  leveling  capability  built  into  the 
operating  system.  Wilkes  (1971)  presents  an  analysis  of  the  stability 
of  such  a  system  and  Mills  (1971)  describes  the  algorithm  in  use  at  MIT. 
The  objective  of  this  section  is  to  illustrate  how  analytic  models  such 
as  those  developed  in  Chapter  2  may  be  used  as  an  integral  part  of  such 
a  control  System.  Clearly  a  model  for  this  purpose  should  not  require 
a  great  deal  of  computer  time  to  solve,  or  any  gains  resulting  from  the 
use  of  the  model  could  be  lost  in  the  extra  overhead  required  to  support 
the  control  algorithm. 

5.4.1  The  System 

Figure  5.7  illustrates  the  structure  of  the  combined  computer  and 
user  subsystems.  Of  all  potential  users,  only  a  fraction  will  want  to 
interact  with  the  computer  at  any  particular  time.  The  system  will  deter¬ 
mine  how  many  active  users,  N,  will  be  able  to  establish  a  connection 
(logon)  and  then  use  the  computer.  The  procedure  which  performs  this 
control  function  will  be  called  the  Terminal  Allocation  Algorithm  (TAA) . 
Appendix  E  contains  a  listing  of  the  SIMULA  program  used  to  investigate 
a  few  (of  the  many  possible)  different  versions  of  a  Terminal  Allocation 
Algorithm. 

The  global  structure  of  the  program  is  illustrated  in  Figure  5.7. 

The  data  gathering  facilities  and  the  central  processor  and  input/output 
subsystems  are  slightly  modified  versions  of  the  simulation  used  to  study 
TSM0D2  in  Section  3.4.  The  changes  from  the  previous  model  are  the  addi¬ 
tions  of  multiple  input  queues  (based  on  the  priority  of  a  job)  for  each 
subsystem,  and  the  modification  of  the  overhead  portion  of  each  quantum 
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to  include  a  constant  part  and  a  portion  which  is  proportional  to  the 
number  of  tasks  waiting  for  service.  Users  at  terminals  are  represented 
by  a  SIMULA  activity,  called  USER,  which  creates  requests  and  inputs  them 
to  the  computing  subsystem.  After  each  request  has  been  completed  the 
user  gathers  statistics  about  his  response  time  and  then  either  creates 
a  new  request  or  leaves  the  system  when  all  requests  have  been  satisfied. 
Each  user  is  inactive  while  waiting  for  the  computer  to  finish  a  request. 
Another  SIMULA  activity,  called  the  GENERATOR,  creates  users  who  try  to 
gain  access  to  the  system.  The  Terminal  Allocation  Algorithm  decides 
whether  or  not  a  new  user  may  logon  to  the  system. 

5.4.2  TAA1 

The  first  Terminal  Allocation  Algorithm  evaluated  is  the  default, 
or  null,  algorithm.  Every  job  requesting  service  is  admitted  to  the 
system  regardless  of  the  current  load.  After  an  initialization  period 
during  which  20  users  submit  a  total  of  100  requests,  new  users  logon 
to  the  system  at  a  rate  slightly  greater  than  users  leave  the  system. 

All  users  have  the  same  statistical  properties  and  the  same  priority. 

The  line  labeled  TAA1  on  Figure  5.8  shows  an  increase  in  average 
response  times  as  a  function  of  time.  As  the  number  of  users  in  the  system 
increases,  average  response  time  increases  in  a  nonlinear  fashion. 

5.4.3  TAA2 

Using  knowledge  gained  from  the  behavior  of  models  like  those  of 
Chapters  2  and  3,  one  may  formulate  a  simple  but  effective  Terminal  Al¬ 
location  Algorithm  based  upon  a  limit  to  the  number  of  people  using  the 
system.  The  only  value  needed  by  the  algorithm  is  the  number  of  users 
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Average  Response  as  a  Function  of  Time  for  TAA1  and  TAA2 
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current  l.y  logged  onto  the  system.  If  the  number  is  greater  than  the 
control  limit  any  new  user  is  denied  access  to  the  system.  Whenever  a 
current  user  finishes  work  and  leaves  the  system  a  new  user  is  allowed 
to  logon  if  one  is  still  waiting. 

The  line  labeled  TAA2  on  Figure  5.8  shows  that  the  simple  strategy 
of  controlling  the  input  rate  to  the  system  will  keep  response  times 
within  design  limits.  Any  idle  time  generated  by  limiting  the  maximum 
number  of  users  may  be  allocated  to  lower  priority  tasks  which  may  be 
interrupted  with  the  arrival  of  more  higher  priority  work. 

5.4.4  TAA3 

The  third  Terminal  Allocation  Algorithm  is  based  upon  the  type  of 
load  balancing  mechanism  in  use  on  the  CTSS  system  at  MIT.  The  control 
algorithm  of  TAA3  samples  the  state  of  the  system  periodically,  and 
dynamically  adjusts  the  maximum  number  of  users  who  are  allowed  to  logon 
to  the  system.  Between  sampling  intervals  the  algorithm  acts  exactly  like 
TAA2.  If  a  user  tries  to  logon,  and  the  number  of  users  already  active  is 
greater  than  or  equal  to  the  control  limit,  the  new  user  is  denied  access 
to  the  system. 

The  philosophy  underlying  dynamic  adjustment  of  the  maximum  number 
of  users  is  based  upon  the  observation  that  users  have  widely  varying  modes 
of  interactive  computer  usage  patterns.  The  parameters  describing  usage 
and  input  rates  vary  with  time.  If  these  parameters  were  stationary  with 
respect  to  time  one  could  choose  a  value  for  the  maximum  number  of  active 
users,  Nmax,  and  never  change  it.  If  all  Nmax  users  are  performing  editing 
types  of  functions  the  central  processor  may  be  underloaded,  and  the  system 
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could  support  more  users.  Alternatively,  if  all  Nmax  users  are  compiling 
and  running  large  programs  the  system  could  become  overloaded.  A  control 
system  that  monitors  the  actual  state  of  the  system  and  balances  the  load 
accordingly  can  increase  the  number  of  users  when  there  is  excess  capacity 
and  can  reduce  the  input  rate  of  requests  when  overloading  occurs. 

At  each  sampling  instant  TAA3  estimates  values  of  the  input  rate  of 
requests  from  the  active  users,  the  sizes  of  the  queues  in  front  of  the 
central  processor  and  the  i/o  system,  and  the  rate  at  which  tasks  request 
service  from  the  i/o  subsystem.  Using  these  values,  TAA3  estimates  both 
the  number  of  tasks  currently  being  processed  by  the  computer  and  their 
characteristics.  Using  TSMOD2,  the  tandem  queueing  model  developed  in 
Section  2.4,  the  control  algorithm  then  computes  what  effects  the  addition 
of  another  active  user  would  have  on  the  state  of  the  system.  If  the  pre¬ 
dicted  value  of  the  system  state  is  within  the  control  range,  the  maximum 
number  of  users  allowed  to  logon  is  increased  by  unity.  If  the  addition 
of  one  more  active  terminal  causes  the  predicted  system  state  to  exceed 
the  control  limit,  the  maximum  number  of  active  users  is  not  changed.  If 
the  measurements  indicate  that  system  state  has  already  exceeded  the  con¬ 
trol  values,  the  maximum  number  of  active  users  is  decreased  by  unity. 
However,  in  this  implementation,  no  users  are  forced  to  leave  the  system 
before  their  session  is  complete. 

It  is  a  well  known  fact  from  the  field  of  control  theory  that  control 
algorithms,  such  as  the  one  outlined  above,  are  subject  to  severe  instabili 
ties.  Since  both  the  input  and  service  functions  are  stochastic  processes 
all  of  the  parameter  estimates  are  random  variables  subject  to  statistical 
fluctuations.  Wilkes  (1971)  examines  the  stability  of  a  simplified  version 
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of  the  previously  described  dynamic  control  algorithm  and  demonstrates 
that  instabilities  are  possible  in  practical  situations.  In  addition 
to  the  variance  of  the  parameter  estimates,  tie  time  delays  between 
changes  in  the  control  variables  and  their  resulting  effects  make  the 
proper  choice  of  a  control  strategy  a  difficult  problem.  The  theoretical 
treatment  of  this  control  problem,  as  applied  to  computer  systems,  is  an 
area  of  future  work  which  is  not  treated  in  the  present  development. 

The  particular  version  of  TAA3  used  in  the  following  simulation  is 
listed  in  Appendix  E  as  activity  ESTIMATOR.  A  common  method  of  estimating 
non-stationary  random  variables  is  to  form  an  estimate  at  each  review 
period  which  is  based  on  a  combination  of  the  past  information  and  the 
current  observations.  TAA3  uses  the  following  exponentially  smoothed 
estimator  for  all  state  variables: 


(5>6)  \+l  =  (1'Qr)  '  \  +  a  ’  Sk, 


k+1 


th 


Xk  is  the  value  of  the  estimator  at  the  end  of  the  k  period,  and  S. 

Kj  Kt  l 

is  the  sample  observations  which  occur  during  period  k+1.  In  the  simula¬ 
tion,  ot=  l/3  and  the  time  period  between  each  sample  was  25  seconds. 

These  values  were  found  by  trial  and  error  to  smooth  the  statistical  fluc¬ 
tuations  of  the  process,  and  to  track  changes  in  the  parameters  of  the  users. 

For  this  simulation  each  new  user  draws  the  parameters,  which  describe 
his  usage  mode,  from  probability  distribution  functions.  Two  parameters 
characterize  user  behavior: 

(1)  the  mean  value  of  the  service  request 


(2)  the  mean  time  a  user  spends  in  the  "think"  state  between 
the  completion  of  one  task  and  the  submittal  of  the  next. 
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Each  user's  parameters  remain  constant  over  the  duration  of  his 
terminal  session,  but  each  request  and  each  thinking  interval  are  random 
variables  drawn  from  a  distribution  characterized  by  the  constant  parameters. 
Thus  the  total  user  load  will  change  as  the  parameters  change. 

5.4.5  Discussion  of  Results 

Table  5.1  presents  the  results  of  a  simulation  of  this  environment 
using  TAA2  with  the  maximum  number  of  users  set  at  30.  Table  5.2  presents 
the  results  of  a  simulation  of  the  same  environment  using  TAA3,  the  dynamic 
control  algorithm.  S  is  the  estimated  average  number  of  tasks  being  pro¬ 
cessed  by  both  the  central  processor  and  the  i/o  system.  TAA3  tried  to  con- 
tr°l  this  value  at  3.5.  The  average  number  of  interactions  processed  during 
each  reporting  period  of  400  simulated  seconds  is  approximately  the  same  al¬ 
though  TAA3  is  slightly  higher  (381  versus  392).  The  average  number  of 
tasks  in  the  system  and  their  average  response  times  are  significantly  larger 
for  TAA2  than  for  TAA3  (4.56  versus  3.54  and  4.83  versus  3.84).  P  is  the 
average  percentage  of  idle  time  spent  by  the  central  processor.  TAA2  had 
significantly  less  idle  time  (.12  versus  .19)  than  TAA3.  This  time  is  not 
wasted  since  it  can  be  used  for  background  tasks  of  lower  priority. 

By  controlling  the  average  number  of  tasks  demanding  service,  TAA3  is 
able  to  significantly  improve  system  performance.  TAA3  uses  TSM0D2 ,  the 
tandem  queueing  model,  to  evaluate  the  effects  of  proposed  changes  in  the 
control  variables.  The  magnitude  of  the  potential  performance  improvements 
indicate  that  future  investigations  should  examine  the  problem  of  designing 
an  allocation  algorithm  which  is  optimal  with  respect  to  stability  and  per¬ 
formance  objectives.  The  goals  of  this  section  were  to  illustrate  how  such 
an  algorithm  can  use  analytic  models,  such  as  those  developed  in  Chapter  2, 
and  to  investigate  what  orders  of  magnitude  of  performance  improvement  one 
may  expect  from  the  implementation  of  static  and  dynamic  control  policies. 


time/400  Number  of  interactions 
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5.5  CONCLUSIONS  AND  FUTURE  WORK 

Chapter  1  contained  a  discussion  of  the  role  of  analytic  models  as 
one  of  the  techniques  useful  in  the  analysis  of  computing  systems.  The 
interactions  of  the  analytic  approach  with  simulations  and  empirical 
studies  were  explored,  and  the  work  of  the  following  chapters  was  placed 
in  context  with  other  studies. 

Chapter  2  presented  the  derivation  of  a  number  of  performance  mea¬ 
sures  of  models  of  time-shared  computer  systems.  Simplifying  approxi¬ 
mations,  developed  for  some  of  these  results,  were  compared  to  the  exact 
expressions.  Each  model  focussed  upon  a  different  feature  of  current 
time -shared  implementations.  Each  of  the  models  is  easy  to  understand 
and  use  because  the  results  are  not  complicated  to  compute,  and  because 
the  structure  of  the  model  is  obvious  to  the  user.  Since  relatively  few 
(five  to  nine)  variables  specify  each  system,  the  models  are  easy  to 
control  in  sensitivity  studies. 

Chapters  3  and  4  presented  evidence  that  the  models  are  robust  in 
the  sense  that  the  behavior  they  predict  is  observed  in  a  wide  range  of 
related  systems  (both  simulated  and  actual).  The  previous  sections  of 
Chapter  5  illustrated  how  such  models  may  be  used  by  designers  and  managers 
of  computer  systems.  The  example  of  Section  5.2  is  a  case  study  of  how 
system  implementors  were  guided  in  an  important  decision  concerning  the 
design  of  part  of  the  operating  system  of  C.mmp,  the  Carnegie-Mellon  multi- 
roim-processor.  Thus  the  models  meet  a  number  of  the  criteria,  stated  by 
John  Little  in  Chapter  1,  required  of  models  which  are  to  be  used  by  de¬ 
signers  and  managers. 
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One  of  the  characteristics  of  umch  of  the  current  literature  dealing 
with  analytic  models  of  computer  systems  is  that  it  lags  developments  of 
actual  systems.  Increased  communication  among  those  who  design  systems 
and  operations  research  specialists  who  create  new  models  would  help  to 
reduce  this  time  delay.  Many  currently  available  models  are  directly 
applicable  to  present  design  problems.  For  example,  the  area  of  the  al¬ 
location  and  scheduling  of  resources  in  networks  of  computer  systems  is 
one  in  which  models,  such  as  those  of  Chapter  2,  could  be  helpful. 

Analytic  models  are  greatly  simplified  abstractions  of  real  computing 
systems.  Therefore  it  seems  appropriate  for  future  model  builders  to 
concentrate  more  on  simplifications  which  lead  to  useful  approximations 
of  important  system  problems,  then  on  exact,  but  very  complicated,  solu¬ 
tions  to  minor  modifications  of  existing  structures.  Naturally  such  ap¬ 
proximation.,  must  be  carefully  studied  to  determine  their  domain  of  ap¬ 
plicability. 


Analytic  modelling  it.  only  one  of  many  techniques  available  to  those  vho 
want  to  analyte,  measure,  improve,  and  create  better  computing  systems. 

One  of  the  goals  of  this  report  is  to  help  place  this  approach  to  system 
modelling  into  perspective  as  an  important  tool,  not  a  panacea,  for  com 
puter  scientists. 
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APPENDIX  A 
DERIVATIONS 


This  appendix  contains  a  number  of  derivations  which  were  referred 
to  in  the  body  of  the  report,  but  did  not  fit  in  any  previous  major  line 
of  development.  The  first  section  presents  helpful,  but  non-standard, 
methods  of  calculating  the  first  and  second  moments  of  non-negative  ran¬ 
dom  variables.  These  results  are  used  in  Section  A2  which  contains  the 
correct  expression  for  the  second  moment  of  the  truncated  exponential 
quantum  interval  of  the  Coffman  and  Kleinrock  (1968)  model,  and  in  A3 

which  contains  a  derivation  of  the  distribution  and  moments  of  0  .  the 

r 

remaining  service  time  distribution  of  a  quantum  in  progress  when  a  new 
job  arrives.  Section  A4  presents  a  solution  to  the  Poisson  source,  ex¬ 
ponential  service  with  constant  overhead  associated  with  each  quantum,  mod¬ 
el  analyzed  by  Adiri  and  Avi-Itzhak  (1969)  and  Rasch  (1970).  The 
solution  method  is  the  one  used  in  Chapter  2,  and  the  results  are  identical 
to  those  obtained  by  Adiri  and  Avi-Itzhak  who  used  more  complicated  trans¬ 
form  methods. 

Al.  THE  FIRST  TWO  MOMENTS  OF  A  NON-NEGATIVE  RANDOM  VARIABLE 

The  well  known  technique  of  integration  by  parts  forms  the  basis  for 
the  following  analysis.  Integrals  may  often  be  simplified  by  application 
of  equation  (A.l). 

(A.  1)  |‘budV  =  uV|b  -  !'bVdu 
j  '  a 

a  a 

If  X  is  a  non-negative  random  variable  having  finite  first  and  second 
2 

moments,  E(X)  and  E(X  ),  and  a  distribution  function  F^(t),  then: 
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(A. 2)  E(X)  =  J'“(l-F  (t))dt 

0  * 

(A. 3)  E(X2)  =  2(  °°t(l-F  (t)  )dt 

0 

Proof 

Apply  (A. 1)  to  (A. 2)  with  the  following  substitutions: 

u  =  1-Fx(t)  du  =  -dFx(t) 

dV  =  dt  V  =  t 

(A. 4)  f’*(l-F  (t))dt  -  t*  (1-F  (t) )  | 00  -  P°°t(  -dF  (t) )  =  (“tdr  (t))  =  E(X) 

^  q  X  ^  o°o  A  oA 

Apply  (A. 1)  to  (A. 3)  with  the  following  substitutions: 

u  -  i-Fx(t)  du  =  -dFx(t) 

dV  -  It  dt  V  -  t2 

(A. 5)  2.j'°Dt.(l-Fx(t))dt  =  t2.(l-Fx(t))|"  -  Jmt2-(-dFx(t))  =  E(X2) 


The  term  t*  (1-F  (t))  |°°  is  zero  because  t*(l-F  (t))  £  j  y‘dFx(y) 
x  10  t 

CD  2  I  00 

and  lim  j  ydFx(y)  =  0  since  E(X)  exists.  Similarly  t  • ( 1-FX( t ) ) | 

t-*CD  t  0 


is  zero  because  tZ.(l-F  (t))  £  |‘VdF  (y)  and  lim  j  y^dF^y)  =  0  since 

A  t  t-*»  t 

2 

E(X  )  exists. 


-co  2 


-149- 


A2.  THE  SECOND  MOMENT  OF  A  TRUNCATED  EXPONENTIAL  QUANTUM  INTERVAL 


The  second  moment  of  a  quantum  interval  is  an  important  quantity  in 
the  Coffman  and  Kleinrock  (1968)  article.  They  assume  that  service  quanta 
have  the  following  distribution  function: 


The  second  moment  of  Q  may  be  easily  calculated  using  equation  (A. 3). 

(A. 7)  EfQ2)  =  2  I  °°t(l-F  (t)  )dt 
0  ** 

-  2  |qte‘Utdt  +  2  J^t-Odt  =  2  J*te"utdt 
0  q  0 


APPly  (A.l)  to  (A. 7)  with  the  following  substitutions: 


u  =  t 


dV  =  2e'Utdt 


du  =  dt 


V  = 


-2e 


■ut 


E(Q2) 


+ ~2(i-«uq) 


-uq 


— (2uq+2) 
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The  final  form  of  equation  (A. 7)  corrects  equation  (16)  of  Coffman 

1 

and  Kleinrock  in  which  they  assert  the  following  incorrect  resuit: 

7  2  e“u9  ?  2 

(A. 8)  E«f )  =  \  -  ^y-(u  q  +  2uq+2)  INCORRECT 

u  u 

A3.  REMAINING  SERVICE  TIME  -  Qr 

Given  that  a  job  from  a  Poisson  source  enters  a  system  and  finds  a 

job  being  served,  what  is  the  distribution  of  Qr>  the  time  from  the  arrival 

of  the  new  job  until  the  one  being  served  finishes?  Section  2.2.4  contains 

a  discussion  of  this  quantity.  Conway,  Maxwell  and  Miller  (1967),  Chapter  8, 

pages  146-147,  present  a  derivation  of  the  properties  of  Qr«  Since  this 

quantity  is  very  important  to  the  results  of  Chapter  2,  and  since  Sheroer 

(1967)  did  not  realize  that  Qr  had  a  distribution  different  from  other 

quanta,  this  section  will  present  a  derivation  of  the  distribution  of  Q^, 

its  Laplace  transform,  and  its  moments.  Hie  following  derivation  differs 

substantially  from  Conway,  Maxwell  and  Miller,  but  the  results  are  the  same. 

Let  Y  be  the  elapsed  time  from  the  beginning  of  a  service  interval 

until  a  new  task  arrives.  A  well  known  result  of  renewal  theory  is  that 

2 

if  a  job  finds  another  being  served  when  it  arrives,  then: 


(A. 9)  P(y  £  Y  £  y+dy)  =  t(l-Fx(y))/E(X) ]dy,  y  *  0 

where  F  (y)  is  the  distribution  function  of  a  service  interval. 
X 

1Coffman,  E. ,  and  Kleinrock,  L. ,  "Feedback  Queueing  Models  for  Time-Shared 
Systems,"  Journal  of  the  Association  for  Computing  Machinery,  Vol.  15, 

No.  4,  Oct.  1968,  p.  557,  equation  (16). 

2 See  Morse  (1958),  p.  10,  or  Avi  Itzhak  and  Naor  (1963)  for  discussions 
of  equation  (A. 9). 
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service  interval  of  length  X 


,  r 

t - Y  k. 

A  - J 

7 

f -  V  M  ] 

time 

(  I  - 

v  U  J 

xr 

new  job 

arrives  in  system 


The  probability  that  will  be  greater  than  some  value  t,  given  that 
Y=y,  is  just  the  probability  that  X  will  be  greater  than  y+t,  given  that 
it  is  already  equal  to  y. 

(A.  10)  P(Qr  >  t|Y=y)  =  P(X  >  t+y|x  >  y) 

1  -  F  (t+y) 

’  -i~  Fx(y)  ; 

By  subtracting  this  result  from  unity  one  gets  the  conditional  distribution 
function  for  Qr  given  Y. 

F„(t+y)  -  F„(y) 

(A,11)  Fo  |Y(t)  =  P«r  5  *  — T  (y)  ;  t.!’  2  0 

F  t+dt+y)  -  F  (t+y) 

(A*  12)  P(t  ^  Qr  s  t+dt  |  Y=y )  =  -±-  y  —  (y)X -  ;  t,y  *  0 

X 

Multiplying  equation  (A. 12)  by  (A. 9)  leads  to  the  following  joint  probability: 
(A. 13)  P(t  £  Qr  £  t+dt  and  y  £  Y  £  y+dy)  = 


(F  (t+dt+y)  -  F  (t4y))  dy 
- - -  ;  t,y  S  0 
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By  integrating  equation  (A. 13)  over  all  values  of  Y,  one  gets  the 
probability  of  the  single  event,  (t  S  s  t+dt).  Using  the  definition 
of  F  (•),  one  sees  that  the  numerator  of  (A. 13),  integrated  over  all  values 

A 

of  Y  is  just  dt  multiplied  by  the  probability  that  X  will  be  greater  than  t 
(P(X  >  t)  -  1  -  Fx(t)). 


(A. 14)  P(t  £  Q  £  t+dt)  =  j  P(t  s  Q  £  t+dt  and  y  £  Y  £  y+dy)*dy 
r  y=0  r 


(1  -  Fx(t)).dt 
E(X) 


t  ^  0 


Equation  (A. 14)  is  the  result  presented  earlier  as  equation  (2.8). 
The  first  moment  of  was  called  ql^  in  Chapter  2.  The  value  of  ql  is 
easily  obtained  from  (A. 14)  by  using  equation  (A. 3). 

(A.  15)  E(Q  )  =  ql  =  r  t,(1  -  FX(t»,dl: 

0  E(X) 

=  E(X2)/(2-E(X)) 

The  Iaplace  transform  of  is: 

(A. 16)  L  (s)  =  E(e"sQr) 

4r 

1  -  Lx<s) 

s  E(X) 

Moments  may  be  obtained  from  Laplace  transforms  of  random  variables  by 
differentiation. 

k  kdkLo(s) 

(A. 17)  E(Q“)  =  (-1).  ___r__ 

*  1. 


|-°°  e'St-(l  -  Fx(t))*dt 
t=0  E(X) 


Is  =0 
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Using  equation  (A. 17)  one  may  show  that  the  following  result  is  valid  for 
.  §  ,  th 

the  k  moment  of  0  . 


(A. 18) 


E«£) 


=  E(X^  S 

(k+l)*E(X)  *  1,2,... 


Equation  (A. 18)  was  presented  previously  as  equation  (2.9). 

M*  overS°Nmodel°ISSON  SOmCE’  EXP0NEWTIAL  service,  and  constant 

An  assertion  of  Chapter  2  is  that  the  methodology  based  on  simple 
expected  value  arguments  will  handle  more  complex  models  than  those 
previously  published.  The  attempt  by  Rasch  (1970)  to  use  this  technique 
in  an  exponential  model  with  constant  overhead  was  unsuccessful  not 
oecause  the  method  lacked  power,  but  because  Rasch  failed  to  recognize 
important  state  dependent  relationships.  He  neglected  the  fact  that  T 

i* 

tne  wait  in  queue  preceding  service  quantum  i,  is  dependent  on  T 

Adiri  and  Avi-Itzhak  (1969)  solve  the  Poisson  source,  exponential 
service  model  with  a  constant  overhead  delay  associated  with  every  quantum, 
Figure  A1  illustrates  the  structure  of  this  model.  The  distribution  func¬ 
tion  of  the  length  of  a  quantum,  Q,  follows. 

t  <  d 

l-e‘U(t'd)  TStSd-K, 

?■  t  <  d-K/ 

Every  quantum  is  divided  into  two  segments.  The  first  interval,  repre¬ 
senting  overhead  delay,  is  a  constant  d,  and  the  second  is  a  random  vari¬ 
able  representing  useful  processing  time.  The  maximum  length  of  the  second 
interval  is  a  constant,  w.  The  total  processing  request,  V,  exclusive  of 
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overhead  delay,  is  exponentially  distributed  with  mean  l/v.  If  a  request 
is  not  satisfied  in  a  quantum,  the  job  leaves  the  processor  and  rejoins 
the  end  of  the  queue.  If  a  request  is  completed  within  the  time  limit  w, 
the  task  leaves  the  system  and  a  new  quantum  may  start. 


P(Task  completes  service)  =  1-e 


-vw 


A 

Poisson  l 
source  with  \ 
rate  A  jobs  J-- 
Se r  unit  time/ 

/ 


constant  overhead 
delay  d 


0  0  0  0 


service 
interval  of 
maximum 
J^Aength  w 


P(Task  rejoins  queue')  ■  e 
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Figure  A1 

Structure  of  the  Adiri/Avi-Itzhak  Model 

Adiri  and  Avi-Itzhak  employ  generating  functions  and  Laplace  trans¬ 
forms  in  non  trivial  ways  in  their  derivation.  The  purpose  of  this  section 
is  to  show  that  careful  application  of  simpler,  more  easily  understood. 
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techniques  will  also  yield  exact  solutions  to  problems  of  this  complexity. 
Transform  techniques  are  more  powerful  than  the  methods  of  Chapter  2  since 
higher  moments  may  be  computed  by  differentiation.  Transforms  may  also 
be  numerically  inverted  to  obtain  the  distribution  function  of  a  random 
variable.  The  price  paid  for  this  greater  power  is  increased  complexity 
which  makes  the  results  harder  to  understand  and  use. 

The  model  of  Figure  A1  is  another  example  of  an  m/g/1  queueing  system. 

Like  the  early  part  of  Section  2.3,  the  first  part  of  the  Adiri/Avi-Itzhak 

work  is  the  calculation  of  total  service  request,  expected  c.tmber  of  tasks 

in  the  system,  and  the  first  two  moments  of  the  quantum  interval.  In  the 

following  discussion  (AA.n)  will  denote  equation  n  of  the  Adiri/Avi-Itzhak 

work.  Minor  symbol  changes  maintain  notational  compatability  with  Chapter  2. 

-vw 

Define:  o'  =  e 

(AA.12)  E(V)  =  l/v  +  d /(l-«) 

(AA.19)  p  =  l-pQ  =  X-E(V)  <  1 

2  2 

(AA.21)  E(M)  =  p  +  X  E(V  )/(2(l-p)),  where  M  is  the  random  number 

of  tasks  in  the  queue  and  in 
the  server 

The  expected  wait  in  queue  until  the  task  enters  the  server  for  its 
first  quantum  interval,  E(T^),  given  in  equation  (2.31),  has  the  same 
derivation  in  this  model  as  in  the  system  of  Section  2.3.4.  Equation  (2.31) 
is  identical  to  (AA.49). 

Adiri  and  Avi-Itzhak  base  their  recursive  equations  on  the  random 
variable,  K^,  the  number  of  queued  tasks  behind  the  tagged  job  as  it  enters 
the  server  for  the  i^  quantum.  E(K^)  is  the  sum  of  three  terms:  (a)  =  the 
expected  number  of  arrivals  from  the  exponential  input  source  during  T^; 
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(b)  =  the  expected  number  of  jobs  that  return  to  the  queue  that  were  in 
the  queue  in  front  of  the  tagged  job  when  it  arrived;  and  (c)  =  the 
expectation  that  the  arriving  job  finds  the  server  busy  (Probability  p) 
and  that  the  job  in  service  returns  to  the  queue. 

(A. 20)  E(Kj.)  =  (a)  +  (b)  +  (c) 

(a)  =  X-E(T1)  =  \*ql* (E(M)-p)  +  X- p -q2/(2.ql) 

(b)  =  e"V‘W.  (E(M)-p)  =  o'*  (E(M)  -p ) 

(c)  requires  careful  treatment  analogous  to  the  derivation  of  ql 

r 

the  expected  remaining  service  time  of  the  job  in  service  when  an  arrival 
occurs.  The  probability  that  this  task  will  return  to  the  queue  is  not  q> 
as  it  is  for  the  other  jobs.  The  fact  that  this  job  has  received  a  random 
amount  of  service  when  an  arrival  takes  place  alters  the  probability  that 
it  will  return  for  additional  quanta.  Shemer  (1967)  neglected  this  fact 
as  well  as  the  fact  that  ql^  ^  ql. 

Multiplying  equation  (A. 11)  by  (A. 9)  gives  one  the  probability  of 
the  joint  events  that  (A)  an  arriving  task  finding  the  system  busy  enters 
y  time  units  after  the  start  of  the  service  quantum  in  process  and  (B) 
waits  less  than  t  time  units  until  that  quantum  is  finished. 

{F  (t4y)  -  F  (y)  } 

(A. 21)  P(y  ^  Y  ^  y+dy  and  Q  £  t)  =  — ■» - ■ - -2 - 

'  '  ql 

Evaluating  this  expression  for  t  =  d+w-y  and  integrating  over  the 
allowable  range  of  y  values  (0,d+w)  gives  the  probability  that  ?.  job  in 
progress  when  a  new  arrival  occurs  finishes  before  the  maximum  quantum 
limit  and  therefore  does  not  rejoin  the  queue.  Call  this  event  "D". 
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(A.22)  P(D)  =  ij-  -  FQ(y)ldy 

1  i-d-K#,,  -vw  „  ,  u, 

=  rrJ  U-e  -F(y)}dy 

4  0 

ql  -  (d+w)«e  W 

q1 


The  probability  that  the  job  does  rejoin  the  queue  is  thus: 


(A. 23)  l-P(D)  =  (d^)1  — 


Multiplying  this  result  by  p,  the  probability  that  the  server  is  busy  when 
a  new  job  arrives,  and  substituting  in  equation  (A. 20)  leads  to  the  expected 
number  of  tasks  behind  a  job  as  it  enters  the  server  for  the  first  time. 

(A. 24)  E(KX)  *  (E(M)-p)-(od-X*ql)  +  p* {X-q2  +  2 • <*• (d+w) }/(2  ql) 

To  get  this  result  in  the  exact  form  of  Adiri  and  Avi-Itzhak  one  need 
only  expand  the  quantity  Xql  and  use  eq.  (AA.12)  and  eq.  (AA.19). 

(A. 25)  Xql  -  X*  (d4(l-o')/v)  =  X'E(v)  •  (1-aO  =  p’(l-a) 


Substituting  p^l-aO  for  X*ql  in  equation  (A. 24)  leads  to  (AA.39).  The 

authors  note  that  their  form  of  the  result  was  derived  from  a  generating 

3 

function  "after  a  rather  lengthy  and  not  painless  process." 

The  equations  for  E(Ki)  and  E(T±)  for  i=2,3,4,...  are  easily  derived, 
as  in  Chapter  2,  once  the  initial  values  for  i=l  are  specified  (equations 
(A. 25)  and  '2.31)). 

"^Adiri  and  Avi-Itzhak  (1969),  p.  644. 
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APPENDIX  B 
LISTING  OF  TSMOD2 


REG  III 

INTEGER  LOOP; 

FOR  LOOP: =1  STEP 
SIMULA  SEGIN 


1  U.'iT  I  L  2<l  MO 


I IJTEGEU  INDEX, SEEP, K,  COUNT,  ST  ATE,  START"  P/f'AX  CUSTOMERS ; 
REAL  SUMS,  SIX  i5S,SnMC,Sl!UCC,3MMRS,3U‘’R,SU!:P.P; 

-  STATT I  ME,  EX  I  TPROS, STATE  I  MTF.GR  *  L,MA PK,  TE/iP,  OUT; 

MARKS, CPI  DLE/CPRF.ST; 


REAL 
REAL 

REAL  MARKS,  101  PLE,  I  3  IEST ; 

REAL  ARRAY  DATA(  1:21, 1:2), INTI (1:2 o), I  ’’T"  (1 : 

I  NTEGER  ARRAY  TRAMS  I  TP  I  3T(  1 :  ?  1 ) ,  SEP’/ 1  CEP  I  ST  (1:21),  STATE PROP (  1 :  ?  1 ) 
INTEGER  ARRAY  INTMl:!''1); 

SET  CPQUEIJE,  lO'UIEUF.; 

ELEMENT  PROCESSOR,  I  USYS,MA  I  M; 

LOJOLEAH  INITIALIZE; 


PROCEDURE  RESET; 
ilF.fi  I  N 

INITIALIZE:  =I:ALSE; 

COURT : =0; 

MARK :  -MAPI'.  2  :  = STATT  I  ME :  =  T I ' 1 E ; 
SUHS:«SUMS3:-snuC:-SUHCC:  -GUI  IRS: -RUMP 
STATE  I  flTEfiP.AL:  =  CPI  PLF :  =  1 0 1  PLF  :  =R. 

FOR  K :  =  1  STEP  1  IIUTIL  21  IIP 


=SUMPR:=P.  R; 


MEG  I  f  I 


TRAMS  I  Tl)  I  ST ( K ) :  =Sr  '  V  I  CEP  I  ST(i' ) :  » 
PATA(i;,l)  :=UATA(R, 2)  :=R.n; 

EMP; 

EMU  OF  PROCEDURE  RESET; 


ATE  PROP ( K ) 


=n; 
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ACT  I  71 TY  TAJK  ; 

BEGIN 

REAL  ARRI VALTI ME/5ERVI CET I  ME , CYC  LEI ; 

BOOLEAN  PASS1; 

PAS  SI : "TRUE; 

ARR I  VALT I  ME :  =TI  HE ; 

HI  3TO  ( STAT  E  PRO  !J  ,  I  NT3 , 3  TAT  E  #  ( T I  HE  -?  !ARK )  *  1 0  0 .  0  )  ; 

ACCUM(  STATE  I  NTEGRAL,MARK, STATE,  3  ) ; 

IF  I DLE( PROCESSOR)  THEN  ACTIVATE  PROCESSOR  AFTER  CURRENT; 
Vi  A  I  T  ( CPQUEUE )  ; 

TEMP: -TIME -ARR I  V ALT I  HE; 

SUMP* :  ■SUMU+TEMP; 

SIJMRR :  »3UHRR+TEMP*TEHP; 

SOUS :  ■SUI1S+SEUVI  CETIME; 

SUMSS :  -SUMSS+SERV I  CET I  ;!E*SERVI  OET I  ME ; 

3UMC :  =SUi'1C+CYCLEl ; 

SUMCC:=SUMCC+CYCLE1*CYCLE1; 

SUMRS :  =SUMRS+TEMP*SERV  ICETIME; 

HISTO(TRANSITDIST, I NT1 , TEMP, 1 ) ; 

HI  STO  ( SER'/I  CEO  I  ST/  INT2,SERVI  CETIHE,1); 

HI STO( STATEPROB, INT3/STATE/ (T IME-MARK) *100 . 0 ) ; 

INDEX : «S  ERV I CET I ME*20. 0  +  1.0; 

ACCUM( STATE  INTEGRAL, MARK, STATE, -1); 

I NDEX: » I F  I IIDEX  LF.Q  21  THEN  INDEX  ELSE  21; 

DATA(  I  NDEX,  1) :  =*DATA(  I  NDEX,  1  )+TEMP; 

DATA(  INDEX,2):aDATA(IMQEX,2)+1.0; 

COUNT :  ■COllHT+1; 

IF  (INITIALIZE  AND  COUNT  EQL  STARTUP)  THEN  RESET; 

IF  COUNT  EQL  MAXCUST0MER5  THEN  ACTIVATE  MAIM; 

END  OF  ACTIVITY  TASK; 


ACTIVITY  GENERATOR; 

BEG  I  N 

G1:IIOLD(NEGEXP(1.0,SEED)); 

ACTIVATE  HEW  TASK  AFTER  CURRENT; 
GO  TO  Gl; 

END  OF  ACTIVITY  GENERATOR; 


-160- 


ACTIVITY  COMPUTER; 

SEC.  IN 

MEAL  OVERHEAD, PUAMTA; 

Cl :  EXTRACT  F|RST(CPntJF.!)F.)  '.'HEM  TASK  pn 
MEG  I II 

C'.l :  OVERHEAD :  -NORMAL  ( .MS, . nlF, AEEn) ; 
IF  PAS SI  THEM 
KEG  1 1! 


CYCLE  1 :  =*T  I  t'E-ARr'  I  ''ALT  I  OE+OVERME AP ; 

PASS1: -FALSE; 

END; 

QUANTA:  -NUitl  AL( .  ns, .  PI  5,  SF.E^ ) ; 

S  E  M  V I  CETIfiE:  -3EMVI  GET  T'E  +  nHAMTA; 
HOLtKOVEUMEAP+QMANTA) ; 

I MC LUGE (TASK,  I OQUEME ) ; 

IF  I DLE ( I OSYS )  THEN  ACTIVATE  I C5YS  AFTER  CURRENT; 
El  ID 

OTHERWISE  KEG  I  N 


ACClin(CP!OLE,HARK?.,CPREST,  1.0); 
PAS  SI VATE; 

ACCUf  *  (CPI n  LE  ,  MARKS , CPRE  ST, -1 . 0 ) ; 

EMI); 

GO  TO  Cl; 

END  OF  ACTIVITY  COMPUTE1!; 


ACTIVITY  I  0 PROCESSOR ; 

AEG  I II 

REAL  I OSERVI CE; 

101:  EXTRACT  FI  RST(  I  OOIJEUE)  WHEN  TASK  nn 
AEG  I II 

I  OSERVI  CE:  »'JN  I  FORIi(  0.0,  .  I!,  SEEM  ); 

HOLD( I OSERVI CE) ; 

TEMP:  ■HIM  FORM (  n.  n,  1 .  n,. SF.EP  ) ; 

IF  TEMP  LEQ  EXITPRO!)  THEM  ACTIVATE  TASK  ArTFR  CMROfMj 
ELSE  II  EG  I  1 1 

I MCLHPE (TASK, CPQUEHE ) ; 

IF  I OLE( PROCESSOR)  THEM 

ACTIVATE  PROCESSOR  AFTER  CHRRFMT; 

END; 

END 

OTHERWISE  KEG  I II 

ACCIJIK  101  PLE,r,ARK3,  I  OREST,  1.0); 

PASS  I VATE; 

ACCUM( IOIPLE,HARK3,  I  (V?EST,  - 1 . 0  ) ; 

END; 

GO  TO  101; 

END  OF  ACTIVITY  IUPKOCESSOR; 
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ENO  OF  ACTIVITY  10 PROCESSOR; 


READ  ( SEEP, STARTUP, MAX CUSTOMERS) ; 

WR I  TE (  '  SEED:  »', SEEP,  1  STARTUP : »'  /STARTUP,  'MAX CUSTOMERS  :  -'  , MAXCUSTOMERS  ); 
EXI TPROB: ■. 125; 

INITIALIZE: -TRUE ; 

FOR  K:»l  STEP  1  UNTIL  20  DO 
I?  EC,  III 

INT1(K):-1.5*K; 

I NT2 (K) : » . 1*K; 

I NT3( K) :  =*K  —  1 ; 

END; 

PROCESSOR  :»  NEW  COMPUTER; 

I OSYS : “NEW  IOPROCESSOR; 

MAI N: “CURRENT; 

ACTIVATE  NEW  GENERATOR  AFTER  CURRENT; 

PASSIVATE; 

ACCUM(STATE  INTEGRAL, MARK,  STATE,!)); 

ACCUM( CPI PLE/MARK2/ CPRE5T, 0. 0); 

ACCUM< IOIOLE/MARK3/ 1  OREST, 0.0); 

WRITEC  TIME  AT  RUN  COMPLETION  IS', TIME,'  NUMBER  OF  TASKS  PROCESSED  IS', 
COUNT); 

WRITEC  CURRENT  STATE  I  S  5 , STATE,  '  AVERAGE  STATE  IS', 

STATE  I NTEGRAL/ (T I ME-STATT I  ME ) ) ; 

TEMP: *SUMS/ COUNT; 

OUT: =SQRT( SUMS S/ COUNT-TEMP* TEMP  ) ; 

WRITEC  SAMPLE  AVERAGE  AND  SO  OF  SERVICE  TIMES  ARE ',  TEMP,  OUT) ; 

TEMP : =( COUNT* SUMRS-SUMR*3UMS )/ (COUMT*SUMSS-SUMS*SUMS ) ; 

OUT :«(SUMR-TEMP*SUMS) /COUNT; 

WRITEC  REGRESSION  ESTIMATE  OF  SLOPE  AND  INTERCEPT  ARE ', TEMP, OUT) ; 

TEMP:  s»5UMC/ COUNT; 

OUT : »SQRT (5UMCC/COUMT-TEMP*TEMP) ; 

WRITEC  SAMPLE  AVERAGE  AND  SD  OF  FIRST  WAITING  TIMES  ARE ',  TEMP,  OUT) ; 

TEMP:  ■SUI1R/ COUNT ; 

OUT: aSQRT( SUMRR/ COUNT-TEMP* TEMP ) ; 

WRITEC  SAMPLE  AVERAGE  AND  SD  OF  RESPONSE  TIMES  ARE ', TEMP,  OUT) ; 

WRITEC  PROBABILITY  PROCESSOR  IS  IDLE  I  S  '  ,  CPI  P  LE/ (T I  ME-STATT  I  ME  ) ) ; 

WRITEC  PROBABILITY  I  OSYSTEM  IS  IDLE  I  S  ' ,  1 01  DLE/ (T I ME-STATTI  ME  ) ) ; 

WRITEC  THE  TABLE  DISPLAYS  RESPONSE  AS  A  FUNCTION  OF  SERVICE'); 

WRITEC  INTERVAL', 'AVERAGE  R', 'NUMBER  OF  POINTS'); 

FOR  K:-l  STEP  1  UNTIL  21  DO 
BEGIN 

TEMP: = I F  DATA(K,2)  GEQ  1.0  THEN  DATACK, l)/OATA(K, 2)  ELSE  0.0; 

OUT:»K/20; 

WR I TE( OUT, TEMP, PATA(K,2)); 

END; 

END  OF  SIMULA  BLOCK; 

END  OF  PROGRAM; 
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LISTING  OF  TSS/360  MODEL 

’■I  .1 

t-;t ic.fr  startcloc*,si  Tp'tf w^mfanj 

f  XT!  v  A  L  PROCEDURE  LTSTC.LPM!  -T.f  A*E  :.CF;E',ULLTApLE  I 
•  LAL  C V E  "WE  AJ,  VflTMr  A •  j 
r.nn.rA*1  AIT#  I  0  JFLj  *  ■<  A  I  T  ,  PLl'PI 
rm.OE"  AXllSERS, 

•  i  C  M E  J  T  A  o  ►.  N  T  n  t  T  ,i  $ 

■'•AXTASKSIf  M”PL  I  ST,  LI,  STAGES  ,  GhiA  /iELb| 

SCM-ppTAP£^T3ns  3  #>}> 

T-,1  • 

I'TEGER  ARRAY  SCH£QTAH{HSCHEnTA8F.-YT«ItS»ll9)  I 
r-Tf-ft?  jU'nFTAS«r,  P  AGES'JSEL:  ,  Q"A*  ta  #  i  ollvll  , 

PR  PR  I  Ty,  T  P'LSLICEpAXCH. 

M AXp’GRO#  IT-.  TSfc  :?,  mPR£  ,  PAGEOElAYj 
I  'Tr  GFR  SEEr>l#SFtn2,SFE03,T«ArEtEVFLiSEE04,SLt05,SEEOf  #SEfrj/ t 
LIST  r  A  T  A  ( C  lA^PELP,LC«>PAr.tS»PAGEOf.LAY,MAXTASKSONOlSPLPT,‘’AXUPERS, 
TRACr.LFVEL.  bPlTpEiOVEPRFAn,THJN<#  VMTMEAN , W3"i AN  1  | 

E  "  R  '  A  T  L‘ATAPRIM<  K<#  •  CHANELS' ,  P,  •  L  C  S  PAGES'.p,*  nSEC  PAGF  DEU* 

»!*,’  DISP  TASKS’, A1,1#U#'  USERS', P,’  l'VFL  TRACE* 
Id,’  MP.S  SI-ULATEO  TIME'  ,  "IV,  3,  »  OVE'hEAP  FACTOR*, 
Al,l,  13,  •  SECS  THINK  TIME', ns, 1,1  MSEr  COMPUTE  TpE' 
I«,’  PAGE  vORH  SET’, Al, 1)1 
LOCAL  LABEL  NOOAT/sLrFTi 

PRIORI T  Y  s 1 j 

TprStlCF  *  ?  i 

U '  J  A  T  A  ■  3  | 

M  A  XCR s 4  | 

*UXl'r,RD«5l 
0  T  R  a  6  I 
TSE‘:H37| 

MPPf  3  <>  J 

IOLF V  E  L  *  9  I 

f’ A Kr  SOHF[iJLFTAHLE(SGMn.lTAr-E‘!TRIFSlSCHEUTAM>  | 

Of  T  G  A  T  A  l 

:5  E  A  n  (  D  A  T  A  ,  ^JDATALFP)J  *pITE(DATA,nATAPRIuT>  i 

t;E%  r: 

’ TF.r.FR  ARRAY  PASERO  -ififi,  PACEROHO  ■•MAfs.Vd  |  1AXUSERS*2  >  I 

IMFCMJ  PAGEti\/TRV,sErP| 
rp  Sl'E'J«2B,93  D 0 
*R  I ' ‘ t.1  L  A  RIG1N 
REAL  ST  ART  IuLET  I*'E  j 

ARRAv  T-MVi  AVG, HARO, STARTPAGF, ALL,  I  JLET  pE  < -2  5  3*1 )  , 

ARRAY  ACTUALUUA‘,TLFIJ0T»U-2I1H)  I 
ARRAY  FAJLTS<-2 SSI)  } 

rn.niAT  r,ABP( ’USRi  ,09.2,  ’  USER',?13,'  PEbP’,06,1,'  CPM’*',DS,3, 

'  «RKST,P,'  IPRij',  13,  •  FAULTS', 13#’  OIBP',13, 

*  ELIC'.P,’  TASKS', 13, «  'ISHPG',  1 .5 ,  ’  TOP’t '  ,  T4  ,  A 1 )  I 
PTFGER  PROCEDURE  F  A  I  R5HA®F  I 

FAIRSMARE*CNTirR(LCSPAGES/MUHOrTASKS)  » 

FLF.MEVT  ELlNTEF.'JALSCMEnuLEP, 

ELTImER, 

ELGUFUpSOa-'KER, 

ACT! vEtaSk  j 

ELEMENT  ARRAY  EL  L.'SF  R  ,  P 1  < 1 1  M  A  X  JSF  Rr> ),  ELPAGEPROcESSP  R  ( 1 J  CHANNELS  )  I 
SET  0  I SP 1 0 ,  PISPEX, 

ELICIBLELI3T, 

I  Nt  AC T  I  YEL  PT  J 
ACTIVITY  TASK(  USf  9M|!  )| 

P  TFGER  IISERn'Im, 

BEG!  m 

FORMAT  PGOUTCPTW  ,19,2,  »  TASK' ,  13,  P,  '  PAGESQUT  AT  T^  A  I  T  •  ,  a  1 )  j 
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BOOtEAN  PAGEWAIt#  JOBOUMOl 

?MJrrr2Tin?n5ST,JIHeCOIJNT,STAPTTlME«TlM5tErT*STARTPA6ENA!T| 

INTEGER  QUAMTAUSEr),WQRKING$ET,  PAGEFAULTSj 

INT9EG1NSTE*  *EwHACESREQ»  PACECOUNT,  PAGESOUT,  NEWPAGr.PAGESTOGET, 

REAL  VMTIMEPiECE} 

VERYTOPOETASKi 

pagefaults*qua\taused*?) 

TlMELEETAVHTlMf:j 
PAGESTOGET  *  NEWPAGESREQI 
TQPOF TASK  I 

VNT IMEPIECEtT DELEFT/ (PAGESTOGET*!)  I 
FOR  NEWPAGF*(!?,1,PAGESTQGET)  do 
BEGIN 

IF  TlNEC0UNT*VMTIMEPtECE  LSS  SCHEDTA0(STE| TJHESLICE >  THEN 
BEGIN 

CANCEL(ELTIHER) I 

HOLOCvKTPEPIECOl 

LISTO(ACTUAIQUANTLENGTH,0,100,0.5|VMTIMEPIECE)I 

TlHECOUNT*TlMECOUr4T*VHTlHEPIECEi 

END 

ELSE  BEGIN 

comment  timer  interruot  COMES  HERE  I 
LISTO<ACTUALQUANTLENGTH,0,1«0,0,5i 

passivate.  I  CWE0T/'B<STE* TIME:SL,CE  ,*TIMEC0UNT>  1 

GO  TO  TOPOFTASKI 
END| 

IF  NEWPAGE  EQL  PAGESTOGET  THEN  GO  TO  TWA  I T | 

PAGEENTRYiPAGEENTRYm 

PAGERQHOWMANY(PAGEENTRY)*t| 

PAGERQWHO (PAGE ENTRY )*US£RNUMj 
PAGEFAULTS*PAGEFAULTSvt| 

PAGEWAITiTRUEl 

STARTPAGEWAIT*TIME| 

ACTIVATE  ELOUEUESCANNER  DELAY  PAGEDlLAY! 

PASSIVATE 
ENOI 
TWA  IT  | 

COMMENT  ISSUE  TWA  IT  ! 

PAGESOUT  ■  PaGECOUNT  *  FAJRSHARE I 
IF  PAGESOUT  GTR  0  THEN  BEGIN 

startpagewait*bj 

pageentry*pageentry*ii 

PAGERQWH0(PAGFENTRY)»USERNUM| 

PAGERQHOWMANY(PAGEENTRY)*rPAGESOUT| 

end^f'pminmut?  2  THEN  ‘,"1TE,TIHE/1MB<USE,,NUM,P*SESOUT,P(OUT)l 

ACTIVATE  ELUSER(USERNUM)  AFTER  CURRENT! 

ACTIVATE  ELQuEUESCANNER  AFTER  CURRENTl 
TRANSFER (TS I (USERnUM),  JNACTI VEL1ST! I 
TIMECOUNT*0| 

PASSIVATE! 

GO  TO  VERYTOPOFTASK 
ENO 
END! 

PROCEDURE  r ILEINCI.  X Cl  1ST (  LTS X  )  j 
ELEMENT  LTSIl 
INSPECT  LTSI  WHEN  TASK  DO 
BEGIN  ELEMENT  7SJINLISTI 

INTEGER  LTS  X  PR  1 1  REAL  LTSJSSTILOSAL  LABEL  OUT! 


-1 64- 


lTSIPRi=scmecFa:?<ste,  priority)  j 

LT5ISST«SST} 

TSI  r-LlST*Hf.4U(ELl5IBLFLlST>| 

FOR  TSI  IMLISTsSUC(TSI  IUJST)  wmjl£  EXIST  (TSI  I NL  1ST)  00 
INSPECT  TSI  I-jL  1ST  HMEN  TASK  DO 

IF  LTSTPPI  LSS  SCHEDTAB(STE, PRIORITY)  THEN 
REG T N  PPECEOECTSIIMLIST.LTSDl 
GO  TO  OUT  END 
ELSE 

IF  lTSIPHI  EOL  SCHEPTA8(STE»HRI0R1TY)  AND 
iTSISST  USS  SST  THE!'. 

HUI’I  PRECEDE  ( TS II  f'Ll  STitTS  I)  J 
r.O  TO  OUT  END ) 

TRANSFER (LTSJ iELIGI REEL  1ST )  | 

OUT  I  END  OF  E  ILET  EUIGUlSTi 
ACTIVITY  TIMER) 

srciM 

BOOLEAN  FORCED) 

FORMAT  TYME<  *Tmr*,Q9,2,  *  TASK  « ,  I  3,  X3,  S2,  X2,  S2,  X3,  « PR  10*  I  Ty«  **|3, 
X2,»SST«  '|06,liX2#*STE«  * »I3iX2|Sl5( Al)» 

PAGOUTI  *PSF  ♦  ,U«,li  '  TASK  *  # 1 3 » I 7»  *  PAGESOUT  AT  TSENDM6, 

*  PAGES  NF-XT  time  I,A1)| 

TOPOFTIMEH) 

FORCED. FALSE) 

INSPECT  ACTIVETaSK  HHEN  TASK  00 

»ESIN  BOOLEAN  UOIOJ  INTEGER  PAGESOUT)  LOCAL  LABEL  LI 
OLPlO.IQROUNrM 

TIMELEFT.TIMELEFT-SCHEDTAB(STE,TIMESLICE)I 
D'JANTAUSEQ.CUAnTAUSEO  ♦  1) 

IF  QUANT AUSED  G£0  SCHEDT AB < STE . QUANT A >  DR 
PAGECOUNT  GTR  SCHEOTAB(STE.YAXCR)  OR 
NEHPAGE  GEO  SCHEOTAB(STEiHAXPGRO)  Then  BEGIN 
STF.SCHEDTABlSXE,  IF  PAGECOIJNT  GTR  SCHEDTAB C STE , MAXCR > 

THEN  mpre  else  TSENP)I 
SSTsIF  SCHEDTAP(STE,OTR)  EOL  R  THEN  B  ELSE 
TIME*SCHEOTABISTE|OTR>* 

IF  SST  LSS  iS  THEN  SST  ELSE  *1 
CANCEL(ACTIVETASK) j 
FILEINELIGLISt(ACTIVETASK)  j 
PAGESOUTsPAGECPUNT-FAIRSHARE) 

FO»CtD»TRUF| 

IF  PAGESOUT  GTO  *  THEN 
BEGIN 

STARTPAGEwAjT«tf I 
PAGEENTRY.PAGEENTRY*1) 

PAGERawH0(PAGFENT«Y5*USERNUM| 

PAGERDHDwmA,V(PAGEE',THY)«<!.PAGESOUT| 

PAGESTOr’ETa“AX(  .'|PAGEsTnGF.T-NFw0AGE* 

PAGES0UT*UNIF0RM(,2, .7.SEED5))  j 
IF  TRACELEvF-L  GTR  2  THEN 

HR  I TE < TIME/1M00 * USERNUM, PAGESOUT, PAGESTOGET i RAGOUT)  I 
GO  TO  L 

END  OF  PAGING  OUT) 

F \0  OF  timeslJcfemoi 
PAGESTOGETRPAGFSTOGET-NEWPAGEI 
L  « 

IOPOUND«IF‘  NFKpASE  GEQ  SCHFDTAP(PTE»  ioleved 
THEN  TRUE  El SE  FALSE  I 
TI"ECOUNT./| 

IF  TOACEuEVEL  GTR  1  THFf’ 

»RI  TE<TYM£,TIME/10JI4),URERNUM,  IF  OLDIO  THEN  MO*  ELSE  *EX*, 


JJ  l*0'  ELSE  'EX»»SCME0TA8(STE, PRIORITY), SST/1000,STE 

IF  FORCED  Then  »TSFNP  forced*  else  *  Ml 

END  J 


ACTIVATE  ELQUEUESc'AMER  AFTER  CURRENTl 

passivatej 
GO  TO  topoftimeq 
END  I 

ACTIVITY  USER UD.PRTY, CONVERSE , THJNKSECONOS, COMPUTEMEAN, 
TRANSACTIONS*  WORKSETHEANH 

INTEGER  I Di pr T Y, TH I NKSECONDS# TRANSACT  ions* WORKSETMEANl 
boolean  CONVERSE! 

REAL  COHPUTEHEANJ 
BEGIN  INTEGER  J  f 
REAL  TEMP! 

tskio)«new  TASKdon 

NUMOFTASkS  a  NUMOFTASKSm 
FOR  13(1,1, TRANSACTIONS)  00 
BEGIN 

inspect  tsiuO)  when  task  no 
BEGIN 

iobound-iooflti 

starttime*tihei 

VHTIME3NEgEXP(1/C0MPuTEMEAN*SEE01)I 

WORKINGSET-RANOINT(0,2*WORKSETMEANiSEED2)| 

NEWPAGESREO-MAX (0, work  I nGSET»PANOINT(P*PAGECOUNT, SEEDS > ) I 
STE»PRTY*iK  CONVERSE  Then  0  ELSE  10» 

IF  I  EOL  1  THEN  SST*0  ELSE 
SST-SCHEDTAB(STE|OTR)*TlME* 

IF  SST  LSS  0  THEN  SST  ELSE  0 


FILEINELIGLIST(TSKIO))  j 
IF  WAIT  THEN  BEGIN  WAJT.FALSEJ 

ACTIVATE  ELOUEUESCANNEP  AFTER  CURRENT  ENQl 
PASSIVATE  | 

IF  CONVERSE  THEN  BEGIN 
TEMP* (TIME-ST ARTTimE )/1000| 

LISTO(ALL,0|300,2,0,TEMP)| 

LISTO(FAULTS»0»5P,1,0,PAGEFAULTS*,01)| 

IF  VHTIMF  LSS  35  AND  NEWPAGESREQ  LEO  2  THEN 

L.IST0(TRIV* 0,330, ,25, TEMP)  ELSE 

IF  VMT I  ME  GTR  25F  o«  NEWPAGESREO  GTR  10  THEN 

LI5TO(MARDi0, 300, 2.0, TEMP)  ELSE  LIST0(AVG, 0,300, 1,0, TEHP) J 

END  OF  COLLECTING  DATA  I 

IF  TRACELEVEL  GTR  F  THEN 

WRITE<GARR,TIME/1000,U8ERNUH, I, (TIME-STARTTJME)/1000,VMT I  ME/1000, 
;*ORKlNGSET,NEWPAGESREQ,PAGEF  AULTS,  CARDINAL  (DISPJO)* 

CARDINAL (QlSPEX ) , 

CARO  INAL (EL IGIBLEL 1ST), NUMOFTASKS, PAGECOUNTjPAGESUSEO) I 
H0L0 (  THINKSFCONOS  •  1000  )) 

END  OF  INSPECTION! 

END  OF  TRANSACTION  LOOP) 

REMPVE(TSI(ID))| 

TCRMINATECTSMIOMI 

NUMOFTASkSbNUMOFTaSKS^II 

TERMINATE(CURREnT)| 

END  J 

ACTIVITY  PAGEPROCESSOR(J)| 

integer  ji 

BEGIN 

INTEGER  USERNUM,NUMPAGES,  I J 
TOPOFPAGEPROCESSORl 
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N  ^P4GES«PAGERQU0'  MANY<1>| 

J?EP  Jl/MiPAGERlWnOa)! 

PAGFE  THVspAGEE^TfJY-li 
FTP  I=(1,1,PaGEENTRv)  00  REG  I r 
PAr,EPQ  '/HO(  I  )iPAGFROWHO<  1*1)  j 
PAGERQHOWM ANV ( I ) sHAGENOHOWMAMY ( 1*1) |  EMQi 
BEGIN  INTEGER  Ii  PAGIngOPERATICNSI 

peal  getreuuesttjme > 

GETRElUPSTTlMfsTlMEj 
PAGlNGOPERATpf  5*A0S(N(jPPA5rS)//8*l  I 
FOR  1 ■ < 1 , l , P AG  I MGOPER  A  T 1 ONS  >  0:) 

H0LD<U''lrCRH(25,7t,l25t»#G£EO3),, 

PAGESUSEO  s  PAGESUSEO  «  NtJKPAGESI 
INSPECT  TSl(URERNUM)  When  TASK  no 
BEGIN 

PAGEwaiT*F4LSEJ 

pAGECOuNTaPAGECOUNT*NUMPAGES  I 
IF  STARTPAGEWAJT  GTR  0  TUEN 
USTOfSTARTPAGE, 55,330,  .2, 

E|s,n  f  (GrTREQ«jESTTlPEeSTARTPAGEWAlT)/i0g!?i)  j 

I F  PPWAIT  THFN 

begin 

PPwAITbFAlSFj 

ACTIVATF  ELCUFUESCANNER  AFTFR  CURRENT i 
IF  IDLING  Twe  i 
BEGIN 

IOL I vGiF  ALSE I 

LiSTDdULrTnEta^Ka,  ,i»<time*startioletime)/100m 

t-N  J 
ENq  i 
ENDI 
PASSI VATEI 

Gn  TO  TnpOFPAGEPR^CESSGR 
E'Dl 

ACTIVITY  OUEUESCANnLPj 
BEGIN  INTEGER  Jj 
REAL  LAStTIHETHRUj 
TOPOFOUEUESCANNFHj 

rnR  ls{l,l, CHANNELS)  00  IE  PAGEENTRY  GTR  /  THEN 
ACTIVATE  ELPAGEPROCESSORU) } 

ifsSl*lTE|LlNTERN*LSCKCDl"'EH  °EUV  ,TI',E’l-*STTlMETMRU).OVER«EiO| 

LASTT  I  ME  THRU  aT  Jut., 

GOTO  TOPOFQUEUESCaNNEp 
EA'D  OF  0-*SCA»\NERI 
ACTIVITY  INTERNALSCHFOULERl 
BEGIN 

element  ltsu 

INTEGER  PR  1 1 
BOOLEAN  BEHINOONLY) 

BCCLEaN  PROCEDURE  F  trancecr I  TER  I  a i 
ENTRANCECRITrHi A* 

IF  CARDIN AL(OISPIO)*CARnjNAL(OIRPEX) 

THEN  TPUF  FLRF.  FALSEi 
PROCEDURE  POVETnOTSPLISK  L TS I  )) 

ELEMENT  LTSIj 
INSPECT  L TS I  wugN  TASK  QO 
BEGIN 

LOCAL  LABEL  F Oijmqpl Act ) 

SST*  IE  SST  L  SS  THEN  45  ELSr  SST^TImLj 


LSS  MAXT4SKiONOISPLlST 


1U1< 
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ir  IOHOUNP  THEN 
PEG  JN 

INTEGER  LTS IPRI I 
ELEMENT  TNIOl 

LTSIPRi«SCHEOTA0(STE, PRIORITY) I 

FOR  lMO.LAST(OISPlO),PREOnNlO)  WHILE  EXJSTUNIO)  DO 
INSPECT  INIO  WHEN  TASK  CO 

IF  SCHEDTA9(STEiPR!0R!TY>  LEO  LTSIPRJ  THEN 

BEGIN  FOLLOW<lNIO,LTSn  f  GO  FQUNDPLACE  ENDl 
PRECEDE! HEAD (DISPIO) ,LTSI) 

ENO  IOPOUNO  CASE 

ELSE  TRANSFER (LTS IiDISPEX}) 

FOUNOPLACEl 

ENO  OF  MOVE  TO  0 1 SP  LJSTJ 
LOCAL  LABEL  SORTQISPATCHj 
TOPOFINT£RNALSCHtnULER( 

BEHINOONLYiTRUEi 

topofsearchi 

IF  EMPTY(ELIGIBLELIST)  THEN  GO  TO  SORTOISPATCH J 
LTSltFlRSKELIGlBLELlSTH 

FOR  LTS  I  «SUC  ( LTS  l )  WHILE  EXlST(PRED(LTSm  CO 

inspect  preo(Ltsi)  when  task  do 

IF  NOT  PAGEWAJT  THEN 
BEGIN 

IF  BEHINPONLY  AND  SST  GEO  TIME 
THEN  GO  TO  TSInOGOOO 
ELSE  IF  ENTRANCECRITERIA  THEN 
qECJN 

mOvETOOISPLIST(TASKJ| 

C0  TO  TOPOFINTERNALSCHEOULER 
ENO 

FLSE  go  to  sortdispatchi 
tsinogoooi 

ENO I 

IF  not  BEHJNOONlY  then  go  to  sortdispatchi 

BEHINOONlYiFALSEI 

GO  TO  TOPOFSEARCHI 

SORTDISPATCHI 

IF  NOT  EMPTY(UISPEX)  THEN  TRANSFER <P I RST (D I SPEX >» Ql SPEX  )l 
BEGIN 
COMMENT 

THIS  IS  THE  DISPATCHER  PART  OF  THE  SCHEDULER 

I 

INTEGER  II 
BOOLEAN  BUSYPAGERSI 
ELEMENT  OTSJI 

FOR  OTSl»FIRST(OiSPIO)|SUC(DTSn  WHILE  EXIST <0TSJ  >  9 

FIRST (OlSPEX) ,SUC(OTSI )  WHILE  EXIST(DTSU  DO 
inspect  otsi  when  task  do 

IF  NOT  PACEWAIT  THEN 
BEGIN 


ACTIVETASK  *  DTSIJ 

ACTIVATE  activetask  after  CURRENTl 

activate  ELTIMER  DELAY  SCHEDTAB(STE.TIMESLICE).TlMECOUNT| 
passivate  I 

GO  TO  TOPOFINTERNALSCHFDULFRl 
END  I 

BUSYPAGERS»FALSEI 

FOR  I»(1#X»CHANnElS)  00  IF  NOT  IDLE(ELPAGEPR0CESS0R(I ) )  THEN 
BUSYPAGERS«TRUE| 

IF  BUSYPAGERS  THEN 


•■w. ri,  V 


Kf 
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■-5F.GIN 

pp.!AIT  =  TRUF| 

IF  NCT  EMPTY(tuK,I^LELTST)  THE*- 
Rt  G I  ^ 

IOLING*TRuE| 

STaRTIOLETI*'E»TIME 

E^D 

F  *n 
F  LSF 

IF  PAGEENT«Y  LFQ  0  THEN  WAlT«T*Uf  ELSE 
ACTIVATE  ewjueuescanner  AFTER  C»HRE'iT| 

PASS  IV ATE  I 

r.rt  TO  TOPOFInTERNaLSCwEDULEH 
E‘P  or  0 1 SPATCHFR  PARTI 
run  OF  INTER'IALSnHrr)  JLERI 
-C'^ENT  CONTROLLING  CODE  COMES  NEXT| 

PEG!" 

I  TIGER  11 

startclock«clocki 

PAGFE'!TRv*P» 

IDLING*! ALSE  I 
ppwaJT  =  FALSE  » 

IODFLT  *  TRUE  | 
yAlT«TRUEI 
PAGES'-SEO  *  PI 

SFEOlsSEEDi  SEE02*SEED1*17I  SEE03«SEEDl*7l I 

SEE  T4*StE0*23 1  FEF05*SEE0*31 1  SEE06*SEE0»&7 1  SEEC7*SEE0*51 1 

NIUMOFTASkS  *  ?| 

ELGUEUESCANNER  *  NEW  gueufscawneri 
ELTr-ER  «  NEW  TfMFR  | 

ELr'TERNALSCHEDOLFR  =  NEW  JNTFRNALSCHEQULERi 

FOR  Isa.l.CHAMMtLS)  00  ELP AGEPROCESSOR U  )  =  NEW  PAGEPR°CESSOc  ( I  >  I 
FCR  Is(l,i,:lAXUsEr«S>  00 

PEG  IN 

ELoSERU  )*NEW  USFRU.5.T«UE.THINK,VMTMEAW,5?.WSMEAN)| 

ACTIVATE  ELUStR(I)  AT  I*30P!0 

END  | 

EDI 

MOLD!  SIHTIME  •  6P033  )l 

vriTfc  •••••••«••  RFAL  TIME  IN  SECSSCLOCK-STARTCLOCK,  *  ••♦•♦**>| 

LpPlNT(ALLi0#3‘f0#2,'3,l,?» » ALL’  >  I 
l  POINT t TP  IV, 0,303, .25,1,0, » TRIVIAL')  I 
l  PPINT(A7G»0  #300,1,0,,  ,97,  *  AVERAGE  » )  I 
LP3r:T(WARD,0,30P,?,f*,  ,97,  *HARU* )  | 

I  P3l^T(STARTPAGE,0,30e,  ,2#1,P# ’TIMF  TO  START  PAGE  FETCHMI 
l PR  I nT  MGLET IME , P, 300, , t# 1 #  ?# ’ IDLE  TIMF  WHILE  ELIGIBLE  TASKS  * ) I 
l  PR  IK T (FAULTS, 3, 50,1, 2,1,0, 'PAGE  FAULTS* )  I 

LPRlNTIACTUALQUANTLtNGTH,0,lO0»k),5,,99#  ’ACTUAL  COMPUTE  SLICES* )  | 

FNO  OF  SIMULA  RIOCK 
FNO  OF  -UXUSERS  LOOPl 
r-o  getdatai 

O-'ATALEFTI 

F  KP  OF  SCHEGTA?  DECL 
FM*  OF  EVERYTHING 
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APPENDIX  D 

LISTING  OF  SCRIPT  PROGRAMS 


Figure  4.1  is  a  block  diagram  of  the  User  Script  used  for  the 
response  time  experiments  reported  in  Sections  4.2.1  and  4.3.  Figure 
4.3  is  a  listing  of  TESTl ,  the  first  program  in  the  script.  The  fol¬ 
lowing  two  listings  are  of  TEST2  and  TEST3 .  The  terminal  output  of 
an  actual  user  following  the  script  is  also  included.  The  arrows  on 
this  latter  listing  indicate  the  places  where  users  must  insert  input 
data  to  the  script  system.  This  example  output  was  used  as  part  of  the 
training  of  the  users  who  participated  in  the  experiment. 


DIMENSION  IB(8),IE(8) 

2  1=0 

PRINT  899 

899  FORMAT (/'PLEASE  ENTER  N  IN  FORM  J*10**K') 

READ  900,N,NN 

900  FORMAT (211) 

N=N*10**NN 

IF  (N.EQ.O)  GO  TO  10 
PRINT  901, N 

901  FORMAT  ( ' TEST2 :  CYCLES=',I7) 

CALL  CLOCK (IB) 

DO  1  J=1,N 
1  1=1+1 

CALL  CLOCK (IE) 

TRAN=36000*(IE(1)  -IB  (1)  )+3600''"(IE(2)  -IB  (2)  )+600*(IE(3)  -IB(3)) 
TRAN=TRAN+60*(IE(4) -IB(4))+10*(IE(5) -IB(5) )+(IE(6) -IB (6) ) 
TRAN=TRANf.l*(IE(7)-IB(7))+.01*(IE(8)-IB(8)) 

PRINT  903, IB 

903  FORMATCSTART  TIME=  '  ,2ll , '  : '  ,211, ' :  '  ,211 , '  . '  ,2ll) 

PRINT  903, IE 

904  FORMAT('END  TIME=' ,211 , ' : ' ,211, ' : ' ,2ll, ' . ' ,211) 

PRINT  905, TRAN 

9^5  FORMATC RESPONSE  TIME=',F8.2) 

GO  TO  2 
10  PRINT  906 

906  FORMAT(' TEST2  NOW  COMPLETE.  YOU  ARE  IN  COMMAND  MODE') 

STOP 

END 
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REAL  Ml, M2, M3 ,M 

DIMENSION  IB (8) , IE(8) ,C(20000) 

DIMENSION  Ml(30,30) ,M2)30,30) ,M3)30,30) 

100  PRINT  899 

899  FORMAT(/'TEST3:  PLEASE  ENTER  N  IN  FORMAT  12') 

READ  900, N 

900  FORMAT  (1 2) 

IF  (N.EQ.O)  GO  TO  10 
PRINT  901, N 

901  FORMAT( ' TEST3 :  ITERATIONS= ' ,13) 

CALL  CLOCK (IB) 

DO  6  L=1 ,  N 
DO  50  1=1,20000 
50  C(I)=I 

DO  2  1=1,30 
DO  1  J=  1 , 3  0 
Ml(I,J  )=2 
M2  (I, J)=3 

1  CONTINUE 

2  CONTINUE 

DO  5  1=1,30 
DO  4  J=1 ,30 
M=0 

DO  3  K= 1 , 3  0 

3  M=M4M2(I,K)*M1(K,J) 

M3 (I , J)=M 

4  CONTINUE 

5  CONTINUE 

6  CONTINUE 
CALL  CLOCK (IE) 

TRAN=36000*(IE(1) -IB(1) )+3600*(IE(2) -IB(2) )+600*( IE(3) -IB(3) ) 
TRAN=TRAN+60*(IE(4) -IB(4))+10* (IE(5) -IB(5))+(IE(6) -IB (6)) 
TRAN=TRAN+.1*(IE(7)-IB(7))+.01*(IE(8)-IB(8)) 

PRINT  903, IB 

903  FORMAT( ' START  TIME= ' ,21 1 , ' : ' ,21 1, ' : ',211  '  '  211) 

PRINT  904, IE  ’ 

904  RORMAT('END  TIME= ' ,21 1 , ' : '  ,21 1, ’ : ' ,21 1 1  '  211) 

PRINT  905, TRAN  ’  * 

905  FORMAT ( 'RESPONSE  TIME=',F8.2) 

GO  TO  100 

10  PRINT  906 

906  FORMAT( ' TEST3  NOW  COMPLETE.  YOU  ARE  IN  COMMAND  MODE') 

STOP 

END 
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BO  01  5.1  TSS  AT  CMU  TASKI D=0022  04/07/70  19:02  3900  SDte0064 
USER00 

18:56  07  APR  70-BENCHMARK  TESTS  ARE  TO  BE  CONDUCTED  AT  1900  -  2100 


SHARE  PUB PRO/ S 132 JM2 3/ PUB PRO 
CDS  PUBPRO/USERLIB(SYSPRO) 

CZAFV460  ENTER  DSORG  VIP  OR  VSP.  DEFAULT:  MEMBER  GIVEN  OLD  DSORG. 
►ABEND 

hoc  )*--»:>’  *-<(♦*}  0023 

KU 

Initial 

CZUW001  AT  19:04:37:  6  USERS/  0  TTYVS/  6  2741VS#  0  1050VS 
BF03  SOURCE. TESTA  COPIED  AS  SOURCE. TEST1. 

BF03  SOURCE. TESTB  COPIED  AS  SOURCE. TEST2. 

BF03  SOURCE. TESTC  COPIED  AS  SOURCE. TEST3. 

BF03  SOURCE. FFCLOCK  COPIED  AS  SOURCE. FCLOCK. 

CZUiWOOl  AT  19:04:53:  6  USERS/  0  TTYVS/  6  2741VS.  0  1050VS 
A053  MODIFICATIONS?  ENTER  Y  OR  N. 

N 

BO 16  LP  FOUND  NO  ERRORS. 

0000250  E  ***  ILLEGAL  EXPRESSION.  OPERAND  NOT  FOUND  WHERE  REQUIRED 
0000250  X=Y( 

n 


LINE  NOISE.  REENTER 


0000251  E  ***  ERROR  IN  RELATION  OR  LOGICAL  OPERATOR  OR  CONSTANT 
0000251  Z=X.Y 

□ 

A053  MODIFICATIONS?  ENTER  Y  OR  N. 

Y 

[D/250/251 
CD/ 100/2100 

0000100  DIMENSION  IB(8)/JE(8) 

0000200  DIMENSION  Ml(30/30)/M2(30/30)/M3(30/30) 

0000300  100  PRINT  899 

0000400  899  FORMAT(/V  fESTl:  PLEASE  ENTER  N  IN  FORMAT  12V) 
0000500  READ  900/N 
0000525  900  F0RMAT(I2) 

0000550  IF  (N.EQ.O)  GO  TO  10 
0000600  PRINT  901/ [I 

0000700  901  FORMAT(V  TEST1:  ITERATION=V/ 13) 

0000800  CALL  CLOCK(IB) 

0000900  DO  6  L=l/N 
0000910  DO  2  1=1/30 
0000920  DO  1  J=l/30 
0000930  Ml( 1/ J)=2 
0000940  M2(  1/ J)=3 
0000950  1  CONTINUE 
0(100960  2  CONTINUE 
0000970  DO  5  1=1/30 
0000980  DO  4  U=l/30 
0000990  M=0 


0001000  DO  3  K=l#  30 
0001010  3  NWW42(I/K)*M1(K/J) 

0001020  M3(  1/ 

0001030  4  CONTINUE 
0001040  5  CONTI  fUE 
0001050  6  CONTINUE 

0001200  m^^OO^ECiJ-^Cip+MOO^JIE^j-IBC^j+BOO^IE^H^)) 

0001300  TRAN=TRAN+60*(IE(4)-IB(4))+10*(  E(5)-IB(5))+(  I  E( 6  )-l  B( 6 ) ) 
0001400  TRAT4=TRAN+.  1^(  I  EC 7 ) -I B( 7 ) ) +.01*(  IE(8)-ID(8)) 

0001700  PRINT  903/ IB  „  ...  _  _ 

0001701  903  FORMAT(?  START  TIME=  V#2 1 1# V:V#2 1 1#V rV#2l  1# V. 21 1) 

0001702  PRINT  904/IE  011v 

0001703  904  FORMAT^  END  TIME=  2 1 1/ V : V# 2 1 1/ V : ^7/ 2 1 1/ V. 2 1 1 ) 

0001704  PRINT  905/TRAN 

0001800  905  FORMATS  RESPONSE  TIME=  V/F8.2) 

0001900  WRITE(  1/800)  11, IB, IE, IRAN 
0001950300  FORMAT(2H  1/18/81 1/8I1/F8. 2) 

0002000  GO  TO  100 

0002051  906^FORMAT(V  TEST1  NOW  COMPLETE.  YOU  ARE  IN  COMMAND  MODE? ) 
0002052  STOP 
0002100  END 

□ 

A053  MODIFICATIONS?  ENTER  Y  OR  N. 

N 

BO  16  LP  FOUND  NO  ERRORS. 

TEST1 


TEST1:  PLEASE  ENTER  N  IN  FORMAT  12 

- *01 

TEST1:  ITERATION  1 
START  TIME=  19:08:49.86 
END  TIME=  19:03:52.36 
RESPONSE  TIME=  2.50 


TEST1:  PLEASE  ENTER  N  IN  FORMAT  12 
*10 

TEST1:  ITERATION  10 
START  TIME=  19:09:05.15 
END  TIME=  19:09:34.35 
RESPONSE  TIME=  29.20 


TEST1:  PLEASE  ENTER  N  IN  FORMAT  12 
0 

TEST1  NOW  COMPLETE.  YOU  ARE  IN  CONMAND  MODE 


CHCIW  STOP 
FTN  TEST2/Y 

A053  MODIFICATIONS?  ENTER  Y  OR  N. 


N 

BO  16  LP  FOUND  NO  ERRORS. 
7EST2 


TEST2:  PLEASE  ENTER  N  IN  FORM  J*10*«K 
*11 

TEST2 :  CYCLES=  10 
START  TIME=  19:10:49.68 
END  TIME=  19:10:49.70 
RESPONSE  TIME=  0.02 


TEST2:  PLEASE  ENTER  N  IN  FORM  J*10**K 


25 

TEST2:  CYCLES=  200000 
START  TIME=  19:11:14.36 
END  TIME=  19:12:08.27 
RESPONSE  TIME=  53.91 

TEST2:  PLEASE  ENTER  N  IN  FORM  J*10**K 
00 

TEST2  NOW  COMPLETE. OYOU  ARE  IN  COMMAND  MODE 
chciw  STOP 
FTN  TEST3/Y 

A053  EDIFICATIONS?  ENTER  Y  OR  N. 

N 

BO  16  LP  FOUND  NO  ERRORS. 

TEST3 

TEST3:  PLEASE  ENTER  N  IN  FORMAT  12 
10 

TEST3: 1 TERATI  ONS=  10 
START  TIME=  19:16:13.01 
END  TIME=  19:18:07.48 
RESPONSE  TIME=  114.47 

TEST3:  PLEASE  ENTER  N  IN  FORMAT  12 
02 

TEST3: ITERATIONS=  2 
START  TIME=  19:18:25.23 
END  TIME=  19:18:34.12 
RESPONSE  TIME=  8.89 

TEST3:  PLEASE  ENTER  N  IN  FORMAT  12 
00 

TEST3  NOW  OOMPLETE.OYOU  ARE  IN  COMMAND  MODE 
CHCIW  STOP 
FINAL 

CZUWOOl  AT  19:19:00:  29  USERS/  14  TTYVS/  15  2741VS/  0  1050VS 
CZUHW001  AT  19:19:31:  29  USERS/  14  TTYVS/  15  2741VS/  0  1050VS 
B007  CPU  TIME  00:01:24.77  CONNECT  TIME  00:16:35  TIME  19:19 


DATE  04/07/70 
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APPENDIX  E 

LISTING  OF  ALLOCATION  MODEL 


SIMULA  PFOIII 

IIITFffir  l'!PFX/SrFn  /  K,  COtP'T,  3TA7r,  STAPT'T,  MA.vC!"'Tr>MrPf'  • 

I NTFGEP  SNAP,  MAX JPPS,  MAyrroi i M! 'f  r pc  nrr  j  rn  . 

REAL  SUMS,  SUMSS,  S'Jf,r,  Fi!f*rP/  SI !mpc*  fjitfp ,  SUMPT  • 

PFAL  STA.TT I ME, ST  MF  I  NTTOR *  |  t  MARI',  jfmi/  OUT; 

PFAL  ESR/LniAV/l.f.)2AV/Ln!.ipFr^OVSt:/,J|CMppcpp^cr  MApK?  rpipir  r nrrcT 
I'.F.AL  MARK3, IOIOLE,  IOPES7;  ' '  '  ' 

PFAL  01AV,  02  A  V,  01/  02  .MAPF4  ,  MA!'P?  ; 

PFAL  ARRAY  PATA(  1 :  2  1 ,  1 : 2  ),  !  NTl  ( 1 : ?0  ),  |*JT2  ( 1 : 20  )  • 

INTEGER  ARRAY  TRAMS  I  TP  I  ST(  1 :  2  1 ) ,  'll' TV  I  frn  I  ST(  1 :?  1)  STATr nPPP  (1*21  5 
INTEGER  ARRAY  IMT3(  1:20);  '  U  * 1  ]  J 

SF.T  ARRAY  CPOUEtJE ( 1 : 2  ) ,  I  pO!IEUr ( 1 : 2  )  • 

RF.AL  L’ARR/FSLAM/nFLTl/Tl/,'rF/rSRF; 

REAL  LAM; 

ELEMENT  PPOfESSOR  .  I  ('SYS,  MA  I ''  • 

FLFMEflT  URPATr/GrM.!SrRS; 

POOL  FAN'  I  N  I  T I A L  I  Z F  ; 


PROCEDURE  RESET; 

PER  IN 

INITIALIZE: = FALSE ; 

COUNT: =0; 

MAP K :  =MARK2  :  »f'APK3 :  =MAPK4  :  =  ha PK5  :  =STATT  I  Mr  •  =tU'F  • 

SUMS  :  =  SUMS 5  :  =SUMC  :  =SI'NCC  :  *Si,t,pp.  •  =  Si'Mr>  •  =  Ri'><r>r  .  -o  0  • 
L01AV: =L02AV: =0.  0;  ’  ‘  ' 

STATE  I  L'TEORAL  :  aCP  I  PI.  F :  =01A  V :  =02  AY;  =  |  n  I  PI  F  •  =0  p  • 

FOP  K :  =  1  STFP  1  UNTIL  2 1  PO  ' 

RFC,  IN 

TRAMS  I  TP  I  ST  ( K ) :  =SF  PV I  CFP  I  ST(  Y  ) :  =  S  T  A  T  P  R  n  0 r’  tv  )  .  =  n  . 
PATA  ( !' ,  1 ) : =r ATA ( K,  2  ) :  =  0 .  P;  “  '  ' 

E!!P; 

H.'O  OF  PPOCEPim:  pr-SFT; 


-175- 


ACTIVITY  USER(PRIOPITY)  ;  IHTrCFR  pn|np|TY. 
PEC.  I  fj 


ACTIVATE  PrPRFSSnp  A.Fjpp  CMPPFmj; 


PEA!.  ARP  I  VALT  IMF,  5EPV  I  CFTI  MF,  LSUMP,  F”  I  TPPPp  ,  TH I MKTI MF  rvpi  ri  . 
If.TEGER  INTFPACTIOMS/fU!MPPOtiFSTS;  '  '  '  ' 

ROOLFAN  PASS1; 

THIflKTIMF:=f;EGEXP(1.0/30.0,SFFO); 

FX  I TPROB :  =  I  F  MM  FORM  (0. 0001, 1.0,SFr;P)  |  75  jnpn  c 

FLSF  1.0/26.0; 

MUSFPS;-MliSFRS  +  1; 

Nl  IHRFPUE  STS  :  =Mf!  I  FORM(0 . 0, 20 .  P,  SFFn)  +  10* 

Ml  :SERV  I  CFT  I  fIF  :  =CYCLF1 :  =0. 0 ;  ’  ' 

PASS  1 : *TPMF ; 

APR  I  VALT  IMF  :=TI  MF; 

M I STO (STATFPPOB,  IMT3,STATF,  (T I MF-MAPK) *100 . P )  • 

ACCUM(5TATE INTEGRAL, MARK, STATr, 1 ) ; 

ACCUM(P1AV,MARIC4,01,  1); 

HARR :  "flARR+1. 0; 

IF  I  PL  F  (  PROCESSOR )  THE!! 

MAI T(CPOMFUF (PRIORITY)); 

TEMP :  «T  I  MF.-APR  I  VALT  ll'F; 

LSIJMR :  “LSMMR+TFMP; 

SUIT  :*SUMP+TFMR; 

SMMPR : =5UMPP+TEKP*TFMP; 

SUMS  :  =  5t :MC  +SFRV I  CFT  I  MF  ; 
SIJf'SS:=SMMSS*SFRVICFTIMF*SFPVICFTIMr- 
StJMC:  *SIJMC+CYCLF1; 

SUI'CC :  =SMMCC+CYCLF1*CYCI  FI; 

SIIMRS :  =SMMRS*TEMP*SFPVI  CFT  IMF; 

!!ISTO(TRAMSITDIST,  I NT1,  TFMP,  1 )  ; 

HISTOCSERVI  CFP  I  ST,  I  NT2 , SFRV I  <TT  IMF,  1 ) ; 

HI STO( STATE PROP,  I NT3, STATE,  (TIMF-MAPK)*1O0  0) • 
IHPFX:=5EPVICFTIMF*10.0+1.0; 

ACCUIU STATE INTFORAL, MARK, STATF,  -1 ) ; 

ACCMM(02AV,MARK5, 02,-1); 

INDEX  :  =  IF  I  f'PFX  LFO  21  THEN  I TJP  ^  X  F|SF  21* 

PATA( I HPFX, 1 ): =PATA ( I  HP FX,  1 )  +  TFMP; 

DATA ( IHPEX,2):=PATA( I HPFX,  2 )  + 1 . 0; 

COUNT: -COUNT+1; 

I HTFRACT  I  OHS  :  =  1  HTFRACT I  ORS  +  1; 

IF  INTERACTIONS  LSS  NUMPEOIIFSTS  TMFN 
REG  li: 

HOLPCUN  I  FORM(0 . 0,  2 . 0*TH  I  i.'KT  I  f’F,  SFFP ) )  • 

00  TO  Ul;  ' 

FNP; 

NUSERS  :  “flUSEPS  -  1; 

IF  (DEMIFP  GFO  1)  AMP  (MHSFRS  LSS  MAXCUSTPMFPS ) 

THFH  REACT  I VATF  OFHMSFRS  AFTFR  Ct.'PPFMT; 

EHD  OF  ACTIVITY  USER; 
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ACTIVITY  ESTIMATOR; 

BEGIN 

REAL  IJ1,U2,L,EPNEU,  LAMNEW,ESU1,FSM2; 

E1:ESLAM:  =  (FSLAM*T1  +  NAPP)/(T1  +  PCI.T1); 

F.SM1 :  =  ( FSM1*T1+01AV-L01AV )  /  ( T1  +  PFLT1); 

FSM2  :  =  (FSM2*Tl+02AV-LO2AV)/(Tl  +  PF.I.T1); 

FSR : =  ESN1  +  ESM2; 

ESPF:=(ESPF*T1+NPF)/(T1+DELT1); 

IF  (ESP  LSS  LOWPFSPOMSF)  AND  (flMSFPS  GFP  MAXCUSTOMFPS )  THPN 
BEGIN 

Ul : -FSPF/FSM1  +  FSPF; 

U 2  :  =ESPF/ESM2  +  F.SPF; 

LAMIIEW:  =  (HUSFRS  +  1)*ESPF/NHSFPS; 

FPNEW:  “LAMNEW* ( 1 . 0/ ( Ul-  LAMNEV)  +1 . 0/ ( IJ2- L  AMNFW) ) ; 

IF  (FPNEW  LSS  HIGHPFSPPNSF )  ANn  (PrNIFD  GEO  1)  THEN 
BEGIN 

PENI EP:  -OEf? I  FD- 1; 

HAXCUSTOMFRS:«MAXCl»STOMFP$  +  1; 

ACTIVATE  NEW  USEP(l)  AFTER  ClinpFMT; 

END; 

END 

ELSE  IF  ( F.SR  GFG  H I  GHP.FS  PONSF )  ANP  (MAXCUSTOMFPS  GFO  fll'SEPS) 
THEN  MAXCUSTOMERS  ;  *MAXCUSTOMPP?- 1 ; 

WR  I TE ( NUSERS, MAXCUSTOMERS,  ESP,  ESLAM,  ESPF,  Ul,  1)2  ) ; 
NARR;-NPF:-0.0; 

L01AV:=Q1AV; 

LQ2  AV : *02  A V; 

REACTIVATE  CURRENT  AT  TIME  +  OEI.T1  PPIPP; 

GO  TO  El; 

ENO  OF  ACTIVITY  ESTIMATOR; 


ACTIVITY  GENERATOR; 

BEGIN 

Gl:HOLO(HEGEXP(LAM,SEFn)); 

IF  NUSERS  GEO  MAXCUST0MEP5  TI'Ef! 
BEGIN 

HE N I EO ; =PFN  I  FD  + 1; 

GO  TO  Gl; 

END; 

ACTIVATE  NEW  USFR(l)  AFTER  CURRENT; 
GO  TO  Gl; 

END  OF  ACTIVITY  GFNFRATOR; 
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ACTIVITY  COMPUTER; 

BEGIN 

REAL  OVERHEAD,  OIJAHTA; 

Cl  :F.XTRACT  F  I  RST (CPOtJF.UF ( 1 ) )  Ml  USFP  DO 
CEO  IN 

C2  :OVERHEAD  :  =  .  05  +  STATF*.0nS; 

IF  PASS1  THEM 
BEGIN 


CYCLF1:=TIMF-ARR|VALTI MF+OVEPHFAP; 

PASS1 ; *FALSF; 

END; 

QUANTA:  *UN  IFOPMOhOODPl,  .1,SFFP); 

SERV  I  CET I  ME  :  «=SERV  I  OFT  I ME+PUANTA ; 

HOLD(OVERHEAD  +  OlJANTA ) ; 

INCL!JDE(USER,  I  OOUEUF(  PP  I  OR  I  TY) ) : 
ACCUM(Q1AV,MAPK4,Q1,-1); 

ACCUM(Q2AV,MARK5, 02 ,  1 ) ; 

IF  I  OLE ( I OSYS )  THEN  ACTIVATE  I  OS/S  AFTFR  CUPRFNT; 
END 

OTHERWISE  BEGIN 


ACCUMC CPI  OLE, MARK2 , C PRES T,  1.0); 
PASS  I VATF ; 

ACCUM(CPIDLF,MARK2,CPPFST, -1. 0); 

END; 

GO  TO  Cl; 

END  OF  ACTIVITY  COMPUTER; 


ACTIVITY  IOPROCESSOR; 

REG  IN 

REAL  IOSERVICF; 

101:  EXTRACT  F I RST ( I OOUEUF( 1 ) )  WHFN  USFR  DO 
BEGIN 

NPF : *NPF+1; 

I OSERV I CE : “UN  I FOPM(0 . 0, .2, SEED); 

HOVD( I OSERVI CE ) ; 

TEr1P:*UNI  FORM(0. 0,1.0,  SEED); 

IF  TEMP  LFO  EXITPPOB  THRU  ACTI  VATF  USER  AFTRR  CHPPENT 
ELSE  BFGIN 

I NCLUDF (USER, CPOUEUE( PRIORITY)); 

AC CUM ( 02 A V, MARK 5, 02, -1 ) ; 

AC  CUM ( 0 1A  V, MAR  K4 , Q 1 , 1 ) ; 

IF  I  OLE ( PROCESSOR )  THEN 

ACTIVATE  PROCESSOR  AFTER  CIIPRFNT; 

END; 

END 

OTHERWISE  BEGIN 

ACCUfU  IOIDLi:,MARK3,  I  OREST,  1.0); 

PASSIVATE; 

ACCUfU  101 DLE,MAPK3, I  OREST, -1.0); 

END; 

GO  TO  101; 

END  OF  ACTIVITY  IOPROCESSOR; 
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REAn  (SEED,  STARTUP, MAXPFOIJFSTS); 

l/niTFC  SFFO 1 ,  SFFP,  1  STAPTUP ' ,  STARTUP,  'ma  vppnifr«;Tc  ' 
LAM:=1. 0/10.0; 

LOWRESPONSE :  =3. 25; 
l:IGI!RL:SPONSE:=3.  5; 

MAXCUSTOMFRS : *  30; 

INITIALIZE;  “TRUE; 

“1 : =50 . 0; 

PELT1 : “2  5 . 0; 

FOR  K: =1  STEP  1  UNTIL  20  PO 
RFGIN 

IMTl(K) : =1. 5*K; 

INT2(K):=. 1*K; 

INT3(K) : =  K-1; 

Fl!P; 

PROCESSOR  :=  NEW  COMPUTER; 

I OSYS : *NEW  IOPROCFSSOR; 

UPPATF.  :=NEW  ESTIMATOR; 

GFUUSERS : “NEW  GENERATOR; 

ACTIVATE  UPPATF  AT  TIMF  +n^LTl  +  Tl* 

ACTIVATE  GENUSEPS  AT  TIMF  +100* 

MAIN; -CURRENT; 

FOR  K : =1  STEP  1  UNTIL  20  PO 

ACTIVATE  NEW  IJSER(l)  AFTFP  CirrpPNT* 

FOR  SNAP; r  1  STEP  1  UUTII  IE  PO 
RE  GIN 


,  MAXPrrurSTS 


IIOLP(400 . 0  ) ; 

ACCOM (STATE  I NTEG PAL, MARK, STATF, 0 ) ; 

ACCUMCCPI OLE, MAPK2 , CPPFST, 0 . 0 ) ; 

ACCUfH  1 0 1 OLE, MAPK3, IOPEST, 0. 0); 

"R'TECOUHT)j  AT  R"f'  COf'PLFTION  'SMIMF,*  WPfp  OF  TAPES  ponPESPEp 

l.’RITFC  ■  CUPPENT  STATE  I S STATE  •  AVEPArr  STATE  I  r  • 

STATE  I NTFOPAL/ (Tl MF-STATT |Mr ) ) .  *  * 

TEMP : -SUMS/COUNT ; 

OUT : “SORT (SUMSS/CPUNT-TFMP*TFUP ) • 

'/RITF.C  SAMPLE  AVEPACF  AMP  SP  Pf'sEPVICF  TI*«FS  ARF'  temp  mm- 
TEMP;  =  (  COUNT* SUMPS -SUMP* SUMS )  /  (rnffr,'T*Sf  !M<rS-S',M<:*SI,MsI  •  '  T>' 

OUT:  =  (SUMP.~TEMP*SUM5) /COUNT;  ‘  '  ' 

T«1P^SUMC/C0ur1!f  EST"'ATF  0F  SL,'PF  A,!n  A"F.,  tfmp,„„t); 

OUT: “SORT (SUMCC/ COUNT- TFMP^TEfP) • 

A!!P  sn  0F'F,m 

OUT :  aSORT(SUMPR/COUNT-TFMr,*Tn,P) ; 

:-f?ITF(|  SAMPLE  AVERAGE  AMP  SP  OF  nFSnPNS*r  T|Ncr,  Ar>n 1  tcmd  a-itu 
n.TF(  PROBABILITY  PROCESSOR  ,S  ,pLF  IS’  OR,  nLr/  (j|  ja  )  \ . 
WPITEC  PPORAR  I  L  I  TY  IOSYSTFM  IS  |PLF  |  «; »  |  O  I  r>|  r  /  (T  ,,.r.PT«  Tt  ,.r  \  !  ’ ' 
’.1PITFC  AVFPAfiE  rTIf’PEP  If  SYSTEf  1  AfP  P  AP '  ■  r  l^/(TI--^ATT  •  ^ 
Q2AV/ (TIME- STATT IMF));  '  1  /(TI  “-»TATTI’  r), 

'/niTF('  TI'E  TARLF  DISPLAYS  RFSTOMSF  Ar  A 
1/P  ITE( '  INTERVAL',  'AVFPACF  P  ' 

FOP  K : =1  STEP  1  UNTIL  21  PO 
RFC  IN 


FUNCTION  pc  Jjrpvirci). 
PORTS'); 


TEMP : = I F  PATA (K, 2 )  CPO  l. 
OUT : =K/ 10 ; 

*IRITF(OUT,TEUP,nATA(l'  ?)) 

END; 

PFSFT; 

FUP  ; 

END  OF  SIMULA  BLOCK; 


0 


TI'EM  IpATA(K,1)/DATA(''#2) 


^ I r ^  0.0; 
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